-- Logs begin at Wed 2022-08-31 09:00:16 UTC, end at Wed 2022-08-31 10:13:23 UTC. -- Aug 31 09:37:42.498193 dv-cinder-837542-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 09:37:42.506065 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:37:42 2022] *** Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: nodename: dv-cinder-837542-8-iscsi Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: machine: x86_64 Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: clock source: unix Aug 31 09:37:42.508059 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: pcre jit disabled Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: detected number of CPU cores: 4 Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: current working directory: / Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: your processes number limit is 47680 Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: your memory page size is 4096 bytes Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: detected max file descriptor number: 2048 Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: lock engine: pthread robust mutexes Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: thunder lock: enabled Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 09:37:42.508556 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:37:42.548197 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: Python main interpreter initialized at 0x5584945c19c0 Aug 31 09:37:42.548197 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: python threads support enabled Aug 31 09:37:42.548197 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: your server socket listen backlog is limited to 100 connections Aug 31 09:37:42.548197 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:37:42.548594 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:37:42.548681 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: *** Operational MODE: preforking *** Aug 31 09:37:42.548910 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:37:42.548910 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: spawned uWSGI master process (pid: 117472) Aug 31 09:37:42.549122 dv-cinder-837542-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 09:37:42.550246 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: spawned uWSGI worker 1 (pid: 117473, cores: 1) Aug 31 09:37:42.550246 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: spawned uWSGI worker 2 (pid: 117474, cores: 1) Aug 31 09:37:42.550246 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:37:43.203878 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:37:43.208024 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:37:44.288540 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:37:44.288540 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: from cryptography.utils import int_from_bytes Aug 31 09:37:44.289131 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:37:44.289131 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: from cryptography.utils import int_from_bytes Aug 31 09:37:44.290856 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:37:44.290856 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: from cryptography.utils import int_from_bytes Aug 31 09:37:44.291308 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:37:44.291308 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: from cryptography.utils import int_from_bytes Aug 31 09:37:46.777964 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:37:46.778650 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:37:46.778749 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:37:46.778892 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:37:46.779259 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:37:46.779346 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:37:46.779444 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:37:46.779650 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:37:46.779741 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.779967 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.780055 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:37:46.780247 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:37:46.780340 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.780578 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.780675 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.780902 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781021 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781243 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781345 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781557 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781651 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781870 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.781972 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.782187 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.782302 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.782437 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.782531 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.782744 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.782846 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783064 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-8-iscsi {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783172 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783359 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783461 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783665 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783750 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.783969 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.784071 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-8-iscsi {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.784282 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.784369 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.784581 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.784667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.784888 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.785071 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.785211 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.785338 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.785577 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.785751 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.785943 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.786196 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.786333 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.786502 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.786693 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.786819 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787019 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787129 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787322 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787436 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787616 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787739 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.787951 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.788039 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.788270 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.788355 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.788572 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.788668 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.788897 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789003 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789244 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789348 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-8-iscsi {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789568 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789658 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789876 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.789980 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.790197 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.790285 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-8-iscsi {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.790563 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.790648 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.790875 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.790983 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.791180 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.791287 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.791493 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.791583 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.791812 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.791908 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.792114 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.792202 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.792442 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.792538 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.792753 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.792842 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.793089 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.793193 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.793404 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.793501 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.793701 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.793790 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794004 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794100 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794307 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794395 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794613 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794705 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.794910 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795004 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795209 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795298 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795456 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795543 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795755 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.795853 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796069 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796164 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796338 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796430 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796642 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796746 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.796920 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797033 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797192 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797281 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797508 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797599 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797824 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.797912 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.798069 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.798164 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.798387 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.798476 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.798699 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.798786 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799000 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799096 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799301 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799398 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799601 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799690 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799899 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.799995 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.800196 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.800283 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.800497 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.800583 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.800799 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.801384 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.801634 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.801737 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.801955 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802043 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802267 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802356 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802586 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802734 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802891 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.802978 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.803208 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.803304 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.803588 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.803675 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.803837 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.803923 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.804142 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.804238 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.804476 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.804573 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.804791 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.804886 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.805114 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.805204 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.805417 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.805519 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.805717 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.805813 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806024 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806110 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806330 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806418 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806633 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806728 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806878 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.806967 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.807173 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.807261 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.807469 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.807569 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.807782 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.807934 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808077 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808170 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808374 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808471 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808673 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808760 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.808981 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809072 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809287 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809376 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809587 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809674 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809886 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.809982 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.810184 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.810272 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.810482 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.810580 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.810779 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.810867 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811078 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811172 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811376 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811462 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811673 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811758 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.811977 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.812067 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.812280 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.812368 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.812577 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.812671 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.812880 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813009 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813223 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813343 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813527 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813617 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813830 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.813920 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.814132 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.814233 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.814428 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.814514 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.814741 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.814827 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815040 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815133 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815340 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815479 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815654 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815749 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.815951 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.816037 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.816248 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.816344 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.816866 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.817541 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.817699 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.817786 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818002 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818101 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818311 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818398 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818609 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818701 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.818907 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819002 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819207 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819301 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819509 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819595 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819804 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.819898 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.820103 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.820198 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.820398 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.820484 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.820695 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.820783 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821010 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821103 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821314 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821409 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821616 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821705 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.821915 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822000 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822213 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822308 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822513 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822607 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822823 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.822908 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.823127 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.823214 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.823432 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.823520 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.823748 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:37:46.823837 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.824080 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.824176 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.824402 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.824489 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.824727 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.824816 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825062 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825167 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825373 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825462 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825679 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825766 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.825999 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.826097 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.826309 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.826394 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.826613 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.826698 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.826921 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827010 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827229 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827315 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827539 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827675 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827847 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.827942 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.828163 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.828260 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.828473 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.828567 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.828785 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.828900 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.829116 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.829215 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.829427 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.829516 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.829745 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.829849 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.830056 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.830152 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.830359 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.830445 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.830684 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.830772 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831003 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831098 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831314 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831409 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831628 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831715 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.831940 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.832029 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.832287 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.832384 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.832596 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.832691 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.832907 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833024 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833240 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833410 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833553 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833651 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833853 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.833940 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.834165 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.834264 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.834471 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.834561 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.834788 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.834875 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.835091 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.835187 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.835395 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.835491 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.835699 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.835794 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836003 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836104 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836309 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836398 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836617 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836707 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.836925 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837091 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837256 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837354 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837561 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837649 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837869 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.837959 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.838182 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.838269 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.838489 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.838578 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.838794 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.838882 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839095 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839181 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839397 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839486 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839696 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839785 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.839995 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.840083 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.840296 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.840382 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.840595 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.840683 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.840895 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841001 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841234 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841335 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841536 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841668 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841849 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.841938 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.842148 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.842244 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.842454 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.842542 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.842761 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.842857 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843072 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843168 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843373 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843459 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843681 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843771 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.843988 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.844089 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.844290 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.844391 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.844596 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.844683 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.844904 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845040 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845231 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845319 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845550 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845852 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.845945 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.846155 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.846242 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.846462 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.846548 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.846771 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.846862 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.847076 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.847163 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.847380 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.847468 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.847689 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.847779 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.848515 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.848614 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.848821 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.848918 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.849152 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.849242 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.849479 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.849577 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.849793 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.849890 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.850093 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.850193 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.850414 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.850503 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.850733 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.850830 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851040 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851128 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851339 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851433 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851646 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851736 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.851946 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852035 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852246 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852334 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852547 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852637 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852854 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.852941 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.853178 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.853267 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.853478 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.853575 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.853777 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.853866 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.854077 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.854165 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.854376 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.854464 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.854681 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.854770 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855001 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855099 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855284 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855373 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855582 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855676 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855879 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.855976 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.856186 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.856274 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.856488 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.856576 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.856791 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.856888 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.857156 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.857246 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.857464 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.857552 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.857779 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.857881 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.858085 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.858174 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.858397 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.858531 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.858704 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.858794 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859011 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859102 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859315 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859405 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859620 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859710 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.859927 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860014 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860230 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860326 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860537 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860625 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860839 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.860926 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.861172 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.861271 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.861487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.861575 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.861794 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.861881 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.862094 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.862180 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.862405 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.862496 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.862719 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.862805 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.863025 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.863161 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.863343 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.863463 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.863710 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.863797 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864015 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864115 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864326 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864423 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864635 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864724 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.864940 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.865087 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.865265 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.865355 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.865568 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.865656 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.865876 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866020 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866181 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866269 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866488 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866584 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866790 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.866887 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.867102 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.867189 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.867401 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.867500 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.867713 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.867812 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868012 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868101 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868320 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868416 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868632 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868727 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.868936 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869047 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869270 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869357 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869575 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869664 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869891 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.869979 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.870199 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.870288 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.870504 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.870594 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.870813 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.870900 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.871113 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.871214 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.871413 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.871508 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.871718 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.871806 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872022 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872117 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872325 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872422 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872627 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872714 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.872932 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873089 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873264 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873413 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873568 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873691 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873868 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.873967 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.874166 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.874253 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.874470 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.874567 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.874769 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.874856 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875071 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875160 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875382 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875470 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875696 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875784 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.875996 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.876132 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.876297 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.876387 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.876613 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.876702 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.876916 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877134 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877240 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877326 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877540 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877629 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877838 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.877925 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.878142 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.878237 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.878445 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.878541 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.878748 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.878901 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.879586 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.879692 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.879911 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880000 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880218 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880304 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880529 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880624 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880840 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.880928 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.881173 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.881261 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.881489 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.881591 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.881799 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.881886 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.882107 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.882193 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.882412 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.882510 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.882720 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.882809 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883027 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883121 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883333 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883420 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883641 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883728 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.883948 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884038 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884254 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884353 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884559 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884653 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884864 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.884974 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.885196 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.885284 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.885507 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.885596 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.885814 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.886063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.886188 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.886392 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.886480 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.886704 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.886972 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.887069 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.887304 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.887392 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.887618 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.887706 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.887937 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888035 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888255 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888345 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888566 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888660 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888867 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.888984 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.889221 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.889323 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.889524 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.889614 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.889826 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.889915 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.890134 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.890230 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.890435 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.890531 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.890736 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.890826 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891036 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891133 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891339 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891426 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891635 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891722 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.891935 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892037 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892234 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892325 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892533 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892622 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892834 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.892930 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.893158 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.893247 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.893462 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.893555 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.893759 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.893883 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.894069 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.894163 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.894371 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.894465 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.894708 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.894801 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895015 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895103 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895313 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895403 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895614 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895702 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.895915 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896004 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896219 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896317 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896560 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896649 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896865 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.896974 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.897214 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.897314 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.897517 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.897616 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.897837 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.897925 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.898139 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.898236 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.898438 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.898526 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.898737 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.898825 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899041 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899137 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899342 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899435 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899639 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899737 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.899944 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900040 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900247 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900336 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900549 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900643 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900852 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.900947 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.901173 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.901263 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.901480 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.901570 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.901781 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.901878 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902081 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902168 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902382 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902469 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902685 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902773 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.902997 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903086 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903303 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903399 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903605 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903694 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903905 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.903992 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.904213 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.904308 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.904520 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.904615 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.904818 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.904906 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.905151 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.905257 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.905448 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.905543 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.905747 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.905844 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906048 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906144 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906351 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906439 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906647 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906741 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.906953 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907048 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907256 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907343 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907556 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907643 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907852 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.907959 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.908158 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.908246 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.908457 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.908547 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.908753 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.908842 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909082 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909187 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909387 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909480 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909690 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909780 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.909986 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.910079 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.910802 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.910913 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.911108 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.911259 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.911408 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.911567 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.911709 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.911880 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912016 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912184 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912315 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912489 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912614 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912796 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.912914 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.913132 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.913223 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.913438 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.913525 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.913743 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.913839 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914044 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914132 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914347 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914486 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914649 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914744 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.914973 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915062 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915282 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915420 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915586 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915683 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915890 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.915977 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.916191 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.916288 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.916523 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.916609 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.916826 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.916913 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.917160 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.917259 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.917467 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.917556 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.917776 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.917866 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.918078 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.918168 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.918388 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.918484 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.918694 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.918787 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919000 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919095 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919302 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919402 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919600 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919689 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919907 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.919995 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.920211 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.920299 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.920517 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.920605 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.920817 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.920904 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.921159 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.921249 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.921467 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.921556 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.921764 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.921853 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922069 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922158 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922375 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922538 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922680 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922769 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.922983 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923084 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923288 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923386 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923593 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923681 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923900 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.923987 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.924206 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.924301 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.924507 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.924594 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.924811 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.924899 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.925143 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.925241 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.925448 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.925537 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.925754 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.925848 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.926110 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.926227 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.926414 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.926724 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.926812 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.927034 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.927317 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.927407 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.927647 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.927856 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.927945 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.928244 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.928422 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.928553 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.928855 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.929006 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.929185 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.929487 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.929587 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.929911 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.930088 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.930222 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.931905 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.931905 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932176 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932262 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932344 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932424 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932504 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932593 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932676 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932757 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932757 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932901 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.932999 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933096 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933177 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933322 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933569 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933656 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933900 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.933996 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.934204 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.934334 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.934510 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.934628 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.934830 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.935133 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.935219 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937053 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937142 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937238 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937333 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937417 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937498 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937578 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937658 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937738 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937828 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.937910 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938001 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938090 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938090 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938238 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938328 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938422 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938511 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938628 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938858 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.938957 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.939208 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.939297 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.939526 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.939621 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.939850 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.939945 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.940164 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.940253 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.940479 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.940587 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.940800 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.940890 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.941148 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.941307 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.941457 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.942202 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.942296 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.942587 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.942793 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.942960 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.943217 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.943339 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.943529 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.943849 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.943946 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.944264 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.944355 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.944587 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.944680 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.944895 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.945061 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.945322 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.945485 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.945649 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.945813 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.945975 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.946217 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.946316 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.946592 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.946679 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.946900 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.947223 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.947330 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.947548 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.947788 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.947877 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.948171 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.948360 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.948587 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.948911 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.949029 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.949246 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.949562 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.949669 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.949884 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.950141 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.950230 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.950479 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952223 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952349 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952349 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952503 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952593 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952684 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952775 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952866 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.952949 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953106 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953191 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953272 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953353 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953482 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953482 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953661 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953751 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953877 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.953980 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.954190 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.954280 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.954518 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.954655 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.954833 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.954972 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.955145 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.955235 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.955454 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.955542 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.955762 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.955859 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.956111 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.956352 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.956448 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959353 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959472 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959603 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959691 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959774 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959856 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.959946 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960038 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960122 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960211 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960211 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960374 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960374 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960533 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960623 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960705 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960786 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960786 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.960933 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961044 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961044 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961195 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961276 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961357 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961515 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961652 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.961966 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.962084 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.962272 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.962577 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.962711 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.962880 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.963049 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.963205 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.963373 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.963513 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.963696 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.963835 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964025 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964147 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964334 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964454 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964645 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964788 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.964976 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.965105 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.965292 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.965390 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.965602 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.965691 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.966002 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.966092 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.966314 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.966582 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.966679 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.966940 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.967150 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.967249 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.967555 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.967658 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.967871 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.968074 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.968184 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.968501 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.968648 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.968815 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.968977 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.969153 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.969310 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.969470 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.969622 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.969784 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.969928 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.970102 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.970235 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.970542 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.970638 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.970885 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.970983 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.971193 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.971284 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.971519 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.971617 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.971830 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.971920 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.972153 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.972243 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.972465 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.972561 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.972796 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.972900 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.973147 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.973239 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.973462 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.973552 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.973774 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.973872 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.974105 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.974194 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.974416 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.974505 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.974732 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.974862 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975047 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975137 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975359 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975457 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975670 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975759 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.975986 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.976206 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.976372 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.976605 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.976702 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.976927 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977053 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977265 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977363 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977578 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977666 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977889 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.977980 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.978198 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.978287 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.978505 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.978592 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.978815 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.978916 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.979125 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.979217 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.979434 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.979522 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.979746 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.979844 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.980057 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.980217 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.980369 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.980459 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.980682 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.980780 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981022 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981115 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981340 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981428 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981654 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981745 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.981965 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.982052 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.982277 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.982367 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.982591 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.982681 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.982903 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.983109 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.983259 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.983426 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.983584 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.983759 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.983895 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.984084 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.984204 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.984407 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.984543 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.984724 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.984815 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.985074 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.985170 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.985402 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.985494 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.985708 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.985804 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.986013 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.986142 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.986326 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.986576 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.986665 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.986927 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.987014 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.987251 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.987459 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.987550 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.987854 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.987948 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.988174 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.988364 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.988508 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.988848 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.989062 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.989359 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.989449 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.989716 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.990042 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.990131 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.990368 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.990501 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.990687 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.990994 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.991100 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.991320 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.991480 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.991627 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.991931 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.992027 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.992246 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.992367 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.992555 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.992690 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.992859 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993041 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993184 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993352 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993494 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993660 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993804 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.993971 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.994107 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.994286 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.994417 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.994596 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.994720 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.994918 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995043 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995229 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995348 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995533 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995652 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995853 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.995950 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.996164 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.996253 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.996539 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.996842 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.996930 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.997173 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.997348 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.997476 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.997788 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.997884 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.998094 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.998279 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.998404 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.998710 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.998799 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.999021 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.999242 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.999332 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.999621 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.999717 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:46.999971 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.000087 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.000293 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.000537 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.000633 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.000887 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.001034 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.001232 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.001512 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.001612 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.001854 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.001951 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.002164 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.002261 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.002474 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.002570 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.002806 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.002894 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.003118 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.003208 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.003425 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.003644 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.003839 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.003979 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.004676 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.004818 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005030 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005251 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005363 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005585 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005679 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005895 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.005983 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.006200 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.006305 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.006505 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.006598 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.006830 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.006979 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.007140 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.007392 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.007482 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.007751 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.007864 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.008064 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.008282 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.008375 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.008671 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.008772 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.009001 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.009245 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.009349 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.009613 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.009702 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.009924 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.010080 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.010233 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.010521 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.010611 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.010837 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.010991 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.011144 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.011458 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.011548 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.011807 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.011962 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.012126 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.012273 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.012444 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.012583 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.012759 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.012899 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.013098 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.013236 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.013410 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.013559 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.013723 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.013868 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014035 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014176 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014344 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014521 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014659 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014839 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.014989 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.015305 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.015405 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.015607 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.015710 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.016006 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.016095 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.016333 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.016462 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.016655 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.016907 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.017023 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.017299 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.017401 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.017623 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.017811 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.017944 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.018255 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.018352 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.018577 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.018759 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.018889 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.019192 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.019281 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.019543 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.019650 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.020417 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.020601 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.020746 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.021075 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.021179 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.021385 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.021563 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.021698 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022011 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022107 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022324 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022419 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022629 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022717 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.022934 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023032 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023237 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023326 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023545 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023641 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023845 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.023942 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.024148 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.024236 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.024451 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.024552 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.024755 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.024846 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.025091 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.025183 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.025402 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.025504 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.025705 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.025803 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026008 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026105 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026311 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026400 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026615 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026712 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.026919 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027008 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027226 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027314 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027526 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027829 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.027921 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.028176 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.028282 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.028430 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.028521 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.028731 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.028819 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.029080 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.029186 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.029413 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.029507 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.029728 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.029817 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030050 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030148 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030360 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030459 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030678 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030766 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.030986 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.031081 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.031290 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.031386 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.031610 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.031699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.031920 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.032010 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.032228 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.032315 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.032560 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.032656 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.032872 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033007 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033206 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033296 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033508 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033595 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033811 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.033902 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.034114 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.034203 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.034422 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.034521 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.034736 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.034826 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035047 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035135 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035367 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035530 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035669 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035758 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.035976 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036074 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036275 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036373 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036574 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036665 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036875 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.036983 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.037235 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.037324 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.037546 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.037635 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.037844 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.037930 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.038146 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.038236 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.038446 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.038545 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.038747 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.038836 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039049 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039140 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039347 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039435 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039653 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039741 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.039952 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040050 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040252 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040341 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040549 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040650 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040847 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.040943 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.041170 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.041259 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.041495 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.041595 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.041824 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.041914 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.042136 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.042240 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.042451 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.042550 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.042759 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.042857 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.043078 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.043168 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.043384 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.043477 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.043698 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.043787 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.044003 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.044103 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.044245 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:37:47.044335 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.044604 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.044934 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.045268 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.045577 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.045883 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.046190 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.046499 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.046807 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.047130 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.047451 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.047754 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.048077 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.048386 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.048700 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.049036 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.049346 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.049671 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.049976 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.050281 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.050588 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.050909 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.051218 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.051528 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.051831 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.052137 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.052445 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.052768 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.053101 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.053427 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.053733 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.054054 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.054376 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.054717 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.055030 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.055372 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.055699 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.056010 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.056319 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.056621 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:37:47.056861 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:37:47.197024 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO dbcounter [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Registered counter for database nova_api Aug 31 09:37:47.209971 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO dbcounter [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Registered counter for database nova_api Aug 31 09:37:47.218057 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_db.sqlalchemy.engines [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.224508 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writer thread running {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.229359 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_db.sqlalchemy.engines [None req-37240228-22ea-4813-856f-a6661be6dbca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.235726 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writer thread running {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.281803 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.context [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da05a9a-2a4d-4b28-8333-0debf927f427(cell1) {{(pid=117474) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:37:47.285621 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:37:47.286101 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:37:47.287664 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:37:47.288395 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:37:47.288837 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:37:47.290833 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:37:47.292772 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO dbcounter [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Registered counter for database nova_cell0 Aug 31 09:37:47.293803 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.context [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da05a9a-2a4d-4b28-8333-0debf927f427(cell1) {{(pid=117473) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:37:47.296803 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO dbcounter [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Registered counter for database nova_cell1 Aug 31 09:37:47.297554 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_concurrency.lockutils [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:37:47.298024 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_concurrency.lockutils [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:37:47.299582 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_concurrency.lockutils [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:37:47.300288 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_concurrency.lockutils [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:37:47.300723 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_concurrency.lockutils [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:37:47.303360 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_concurrency.lockutils [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:37:47.304655 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_db.sqlalchemy.engines [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.305397 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO dbcounter [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Registered counter for database nova_cell0 Aug 31 09:37:47.306323 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_db.sqlalchemy.engines [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.309551 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO dbcounter [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Registered counter for database nova_cell1 Aug 31 09:37:47.312623 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writer thread running {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.314098 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writer thread running {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.316453 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_db.sqlalchemy.engines [None req-37240228-22ea-4813-856f-a6661be6dbca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.318916 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_db.sqlalchemy.engines [None req-37240228-22ea-4813-856f-a6661be6dbca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.325119 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writer thread running {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.326555 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writer thread running {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.459509 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO dbcounter [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Registered counter for database nova_cell0 Aug 31 09:37:47.468304 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_db.sqlalchemy.engines [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.469188 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO dbcounter [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Registered counter for database nova_cell0 Aug 31 09:37:47.472910 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writer thread running {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.475727 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG oslo_db.sqlalchemy.engines [None req-37240228-22ea-4813-856f-a6661be6dbca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:37:47.480317 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writer thread running {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:37:47.813946 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: WARNING keystonemiddleware.auth_token [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:37:47.821782 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: WARNING keystonemiddleware.auth_token [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:37:47.836497 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: WARNING keystonemiddleware.auth_token [None req-37240228-22ea-4813-856f-a6661be6dbca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:37:47.843789 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: WARNING keystonemiddleware.auth_token [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:37:48.163117 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: WARNING keystonemiddleware.auth_token [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:37:48.169122 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: WARNING keystonemiddleware.auth_token [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:37:48.174437 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584945c19c0 pid: 117474 (default app) Aug 31 09:37:48.176541 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:37:48.177766 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001802 Aug 31 09:37:48.178166 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Wed Aug 31 09:37:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:37:48.208219 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: WARNING keystonemiddleware.auth_token [None req-37240228-22ea-4813-856f-a6661be6dbca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:37:48.214268 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: WARNING keystonemiddleware.auth_token [None req-37240228-22ea-4813-856f-a6661be6dbca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:37:48.220530 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584945c19c0 pid: 117473 (default app) Aug 31 09:39:06.089917 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:06.090330 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 09:39:06.090890 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:06.102671 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_api:SELECT=3 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:06.103800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_cell0:SELECT=3 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:06.104683 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_cell1:SELECT=3 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:06.105870 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:06.978867 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-125fb36b-8a5a-415d-855a-22641aee33e8 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:07.010280 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-125fb36b-8a5a-415d-855a-22641aee33e8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912682 Aug 31 09:39:07.011175 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 31 09:39:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:09.359766 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:09.360761 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-d02c337b-bcb5-4505-8bfd-bc0343b2ffa2 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 31 09:39:09.361371 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:09.823068 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-c0b19aca-43a7-4eb9-a7a5-aa82276ceeac admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 1, "ram": 256, "rxtx_factor": 1.0}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:09.873702 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-c0b19aca-43a7-4eb9-a7a5-aa82276ceeac admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506439 Aug 31 09:39:09.875219 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:39:10.104217 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-a1c39afc-79ec-4e00-9552-3af59ebc75e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:10.111857 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_api:SELECT=3 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:10.112874 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_cell0:SELECT=3 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:10.114360 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_cell1:SELECT=3 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:10.115709 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:10.175168 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-a1c39afc-79ec-4e00-9552-3af59ebc75e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291208 Aug 31 09:39:10.175743 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 31 09:39:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:12.528139 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-c0b19aca-43a7-4eb9-a7a5-aa82276ceeac admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:12.529213 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-c0b19aca-43a7-4eb9-a7a5-aa82276ceeac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 31 09:39:12.530120 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:13.202491 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-b470c83e-aa8d-4392-9fee-017309e8fc43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:13.243344 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-b470c83e-aa8d-4392-9fee-017309e8fc43 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706940 Aug 31 09:39:13.244619 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:13.256805 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-ad844503-1f2d-402b-bd97-fd027d788e97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:13.294666 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-ad844503-1f2d-402b-bd97-fd027d788e97 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041397 Aug 31 09:39:13.295237 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 31 09:39:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:15.672542 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-b470c83e-aa8d-4392-9fee-017309e8fc43 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:15.673511 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-b470c83e-aa8d-4392-9fee-017309e8fc43 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 31 09:39:15.673917 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:39:16.071247 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-e48b7dc0-28af-46a6-b9b6-14df90c753ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 1024}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:16.090312 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-e48b7dc0-28af-46a6-b9b6-14df90c753ab admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410489 Aug 31 09:39:16.090848 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:16.103672 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-61fb32ae-d645-4efe-a313-8fe4c48b58d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:16.126804 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-61fb32ae-d645-4efe-a313-8fe4c48b58d4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026914 Aug 31 09:39:16.127351 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 31 09:39:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:39:18.520006 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-e48b7dc0-28af-46a6-b9b6-14df90c753ab admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:18.522532 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-e48b7dc0-28af-46a6-b9b6-14df90c753ab admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Aug 31 09:39:18.527822 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:18.966891 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-edca8d98-b18e-482a-9c45-b384c3de6c36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 2048, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:18.986601 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-edca8d98-b18e-482a-9c45-b384c3de6c36 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457017 Aug 31 09:39:18.987142 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:18.999173 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-045b807d-6110-4b70-ac8c-db9ed9319601 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:19.025402 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-045b807d-6110-4b70-ac8c-db9ed9319601 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029505 Aug 31 09:39:19.031126 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 31 09:39:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:21.415709 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-edca8d98-b18e-482a-9c45-b384c3de6c36 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:21.417406 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-edca8d98-b18e-482a-9c45-b384c3de6c36 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 31 09:39:21.417991 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:21.844858 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-0db820da-a32e-4633-967c-3358a12d30b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:21.864385 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-0db820da-a32e-4633-967c-3358a12d30b7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439433 Aug 31 09:39:21.869098 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:39:21.877227 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-555c2bb3-6207-4676-90ec-4f57a0446a33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:21.901006 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-555c2bb3-6207-4676-90ec-4f57a0446a33 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027424 Aug 31 09:39:21.901550 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 31 09:39:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:24.240881 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-0db820da-a32e-4633-967c-3358a12d30b7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:24.241933 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-0db820da-a32e-4633-967c-3358a12d30b7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 31 09:39:24.242342 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:39:24.725839 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-764380c0-3c47-49a4-95e7-d3576e43c472 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:24.751574 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-764380c0-3c47-49a4-95e7-d3576e43c472 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.503020 Aug 31 09:39:24.752174 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 31 09:39:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:39:27.126754 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-0db820da-a32e-4633-967c-3358a12d30b7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:27.127701 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-0db820da-a32e-4633-967c-3358a12d30b7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 09:39:27.128113 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:39:27.586892 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-6241e9d1-bb0d-4bf0-bd85-8f4962e25593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:27.611362 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-6241e9d1-bb0d-4bf0-bd85-8f4962e25593 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475258 Aug 31 09:39:27.612999 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:27.625449 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-47c17dd3-68b7-4af5-a2f3-1afa87117027 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:27.655164 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-47c17dd3-68b7-4af5-a2f3-1afa87117027 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034625 Aug 31 09:39:27.655736 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 31 09:39:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:30.006171 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-6241e9d1-bb0d-4bf0-bd85-8f4962e25593 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:30.007156 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-6241e9d1-bb0d-4bf0-bd85-8f4962e25593 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 31 09:39:30.007565 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:30.409840 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-2166388a-0e9c-43f5-a794-c32a444a8ee3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "id": "2", "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:30.428403 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-2166388a-0e9c-43f5-a794-c32a444a8ee3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414051 Aug 31 09:39:30.428977 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:39:30.441815 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-34a3af78-90f3-40f1-84fd-42b079f3f66b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:30.466053 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-34a3af78-90f3-40f1-84fd-42b079f3f66b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028134 Aug 31 09:39:30.466598 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 31 09:39:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:32.848126 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-2166388a-0e9c-43f5-a794-c32a444a8ee3 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:32.849089 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-2166388a-0e9c-43f5-a794-c32a444a8ee3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 31 09:39:32.849646 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:33.257105 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-1237ddd9-7461-43e2-8683-13d5516f1d83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:33.276428 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-1237ddd9-7461-43e2-8683-13d5516f1d83 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420872 Aug 31 09:39:33.277647 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:33.289604 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-274ef81e-349a-46ba-81b8-9e4c52a1023d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:33.316143 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-274ef81e-349a-46ba-81b8-9e4c52a1023d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030455 Aug 31 09:39:33.317073 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 31 09:39:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:39:35.708150 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-1237ddd9-7461-43e2-8683-13d5516f1d83 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:35.709843 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-1237ddd9-7461-43e2-8683-13d5516f1d83 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Aug 31 09:39:35.710418 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:36.165191 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-bf2d3125-4fb8-42d7-af1d-0b2b531ab958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:36.171498 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:36.185701 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-bf2d3125-4fb8-42d7-af1d-0b2b531ab958 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468513 Aug 31 09:39:36.186678 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:36.200144 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-6b6f081a-ddc9-4d97-a9cf-25fed5972b93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:36.226179 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-6b6f081a-ddc9-4d97-a9cf-25fed5972b93 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031199 Aug 31 09:39:36.226926 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 31 09:39:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:38.614514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-bf2d3125-4fb8-42d7-af1d-0b2b531ab958 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:38.615450 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-bf2d3125-4fb8-42d7-af1d-0b2b531ab958 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 09:39:38.616144 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:39.183915 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-441e7ce7-2940-4dee-8c44-2919c3501946 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:39.204090 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-441e7ce7-2940-4dee-8c44-2919c3501946 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.581834 Aug 31 09:39:39.204631 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 31 09:39:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:39:39.219208 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-82673394-f8de-4cd9-8dba-e035b174a8d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:39:39.244396 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-82673394-f8de-4cd9-8dba-e035b174a8d7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031506 Aug 31 09:39:39.244940 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 31 09:39:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:39:58.134843 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-441e7ce7-2940-4dee-8c44-2919c3501946 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:58.135856 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-441e7ce7-2940-4dee-8c44-2919c3501946 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 09:39:58.136257 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:58.147248 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:58.540763 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-413a1342-6bcf-4432-856c-33b9b7c25c50 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:58.561378 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-413a1342-6bcf-4432-856c-33b9b7c25c50 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418526 Aug 31 09:39:58.561918 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 31 09:39:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:39:59.620748 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-441e7ce7-2940-4dee-8c44-2919c3501946 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:59.621769 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-441e7ce7-2940-4dee-8c44-2919c3501946 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 09:39:59.622158 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:00.134920 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-b6ef7755-8424-48d9-89b0-c43a19200015 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:00.140873 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.wsgi [None req-b6ef7755-8424-48d9-89b0-c43a19200015 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-b6ef7755-8424-48d9-89b0-c43a19200015 admin admin] Request method failure captured: Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Accept: application/json Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Accept-Encoding: gzip, deflate Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Connection: keep-alive Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Content-Length: 0 Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Host: 10.222.0.25 Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Openstack-Api-Version: compute 2.90 Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Openstack-System-Scope: None Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: User-Agent: python-novaclient Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Auth-Token: gAAAAABjDyxvwPAK7xM2E90kKBuuThupDjdcNx5m6jZ-3iORzFauavHbAxwd487LkpJWZ4KGBabqG_dh-gnjEsRC8-gFWFXocePQ6Rvn2yZPtPLHhGag_5VWhQFH9o-ivM3bcl2c3kQ-6pSKaRkPWewmpbVFZ-gHdw_cw8rsk7Xq6Rghp8D8yCg Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Domain-Id: None Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Domain-Name: None Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Identity-Status: Confirmed Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Is-Admin-Project: True Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Domain-Id: default Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Domain-Name: Default Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Name: admin Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Role: reader,admin,member Aug 31 09:40:00.144065 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Roles: reader,admin,member Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_908a4dee0a684e749e89f40e4287b799", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant: admin Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant-Name: admin Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User: admin Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Domain-Id: default Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Domain-Name: Default Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Id: 3c3232bfea3b429697a9f4a4bfb3705a Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Name: admin Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: method: > Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: exception: Flavor 42 could not be found. Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: action_args: {'id': '42'} Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:40:00.145514 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:00.146407 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.147800 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-b6ef7755-8424-48d9-89b0-c43a19200015 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:40:00.149113 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-b6ef7755-8424-48d9-89b0-c43a19200015 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388120 Aug 31 09:40:00.149113 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 31 09:39:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:00.155515 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-26491721-c0b0-422a-862e-b8287a22e5a8 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:00.159595 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:00.178435 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-26491721-c0b0-422a-862e-b8287a22e5a8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027015 Aug 31 09:40:00.178961 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 31 09:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:40:00.189092 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-aefe23fa-9b7d-498f-bde8-c68286c39491 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:00.211557 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-aefe23fa-9b7d-498f-bde8-c68286c39491 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026342 Aug 31 09:40:00.212099 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 31 09:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:40:00.222642 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-a92f3d39-b459-41cc-8fda-d2b2f173de5b admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:00.230320 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.wsgi [None req-a92f3d39-b459-41cc-8fda-d2b2f173de5b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-a92f3d39-b459-41cc-8fda-d2b2f173de5b admin admin] Request method failure captured: Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Accept: application/json Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Accept-Encoding: gzip, deflate Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Connection: keep-alive Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Content-Length: 0 Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Host: 10.222.0.25 Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Openstack-Api-Version: compute 2.90 Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Openstack-System-Scope: None Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: User-Agent: python-novaclient Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Auth-Token: gAAAAABjDyxvwPAK7xM2E90kKBuuThupDjdcNx5m6jZ-3iORzFauavHbAxwd487LkpJWZ4KGBabqG_dh-gnjEsRC8-gFWFXocePQ6Rvn2yZPtPLHhGag_5VWhQFH9o-ivM3bcl2c3kQ-6pSKaRkPWewmpbVFZ-gHdw_cw8rsk7Xq6Rghp8D8yCg Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Domain-Id: None Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Domain-Name: None Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Identity-Status: Confirmed Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Is-Admin-Project: True Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Domain-Id: default Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Domain-Name: Default Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Name: admin Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Role: reader,admin,member Aug 31 09:40:00.233667 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Roles: reader,admin,member Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_908a4dee0a684e749e89f40e4287b799", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant: admin Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant-Name: admin Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User: admin Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Domain-Id: default Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Domain-Name: Default Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Id: 3c3232bfea3b429697a9f4a4bfb3705a Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Name: admin Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: method: > Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: exception: Flavor 42 could not be found. Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: action_args: {'id': '42'} Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:40:00.235086 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:00.235909 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:00.237177 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-a92f3d39-b459-41cc-8fda-d2b2f173de5b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:40:00.238411 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-a92f3d39-b459-41cc-8fda-d2b2f173de5b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016731 Aug 31 09:40:00.238411 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 31 09:40:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:01.202282 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-aefe23fa-9b7d-498f-bde8-c68286c39491 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:01.203306 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-aefe23fa-9b7d-498f-bde8-c68286c39491 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 31 09:40:01.203701 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:01.733751 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-96c85f00-13da-496f-8155-5a809d4c56f2 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:01.738983 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.wsgi [None req-96c85f00-13da-496f-8155-5a809d4c56f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-96c85f00-13da-496f-8155-5a809d4c56f2 admin admin] Request method failure captured: Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Accept: application/json Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Accept-Encoding: gzip, deflate Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Connection: keep-alive Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Content-Length: 0 Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Host: 10.222.0.25 Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Openstack-Api-Version: compute 2.90 Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Openstack-System-Scope: None Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: User-Agent: python-novaclient Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Auth-Token: gAAAAABjDyxxMu63d3XDOx1lMk-AA8ZNK_NzNCS8NsyP02ax88Stv7JV4HEy2EWPHhIhk_pAwe2MaCisr99uGwPndQKMYqn0Jux9r1kcsXSCB04peMQB8BfVXCpq10P5YyLyUPxI8SdeAE-m30IWVXCYkx19K8gWh2RgFTP5ycK6XLZJ1nVdVMM Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Domain-Id: None Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Domain-Name: None Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Identity-Status: Confirmed Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Is-Admin-Project: True Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Domain-Id: default Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Domain-Name: Default Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Name: admin Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Role: reader,admin,member Aug 31 09:40:01.740499 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Roles: reader,admin,member Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_908a4dee0a684e749e89f40e4287b799", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant: admin Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant-Name: admin Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User: admin Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Domain-Id: default Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Domain-Name: Default Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Id: 3c3232bfea3b429697a9f4a4bfb3705a Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Name: admin Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: method: > Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: exception: Flavor 84 could not be found. Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: action_args: {'id': '84'} Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:40:01.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:01.742699 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.743952 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-96c85f00-13da-496f-8155-5a809d4c56f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:40:01.745231 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-96c85f00-13da-496f-8155-5a809d4c56f2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401282 Aug 31 09:40:01.745231 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 31 09:40:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:01.751482 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-3be2e593-73c7-44b7-abdd-92ee771258b9 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:01.766901 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-3be2e593-73c7-44b7-abdd-92ee771258b9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018995 Aug 31 09:40:01.767458 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 31 09:40:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:40:01.777664 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-9ddf03f7-d870-43fc-a44a-451269779385 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:01.793125 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-9ddf03f7-d870-43fc-a44a-451269779385 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019596 Aug 31 09:40:01.793663 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 31 09:40:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:40:01.803216 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-e0c7afc7-d927-4c9a-ad67-8c4182f364b7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:01.808543 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.wsgi [None req-e0c7afc7-d927-4c9a-ad67-8c4182f364b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-e0c7afc7-d927-4c9a-ad67-8c4182f364b7 admin admin] Request method failure captured: Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Accept: application/json Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Accept-Encoding: gzip, deflate Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Connection: keep-alive Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Content-Length: 0 Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Host: 10.222.0.25 Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Openstack-Api-Version: compute 2.90 Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Openstack-System-Scope: None Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: User-Agent: python-novaclient Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Auth-Token: gAAAAABjDyxxMu63d3XDOx1lMk-AA8ZNK_NzNCS8NsyP02ax88Stv7JV4HEy2EWPHhIhk_pAwe2MaCisr99uGwPndQKMYqn0Jux9r1kcsXSCB04peMQB8BfVXCpq10P5YyLyUPxI8SdeAE-m30IWVXCYkx19K8gWh2RgFTP5ycK6XLZJ1nVdVMM Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Domain-Id: None Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Domain-Name: None Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Identity-Status: Confirmed Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Is-Admin-Project: True Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Domain-Id: default Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Domain-Name: Default Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Name: admin Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Role: reader,admin,member Aug 31 09:40:01.810063 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Roles: reader,admin,member Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_908a4dee0a684e749e89f40e4287b799", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant: admin Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant-Name: admin Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User: admin Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Domain-Id: default Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Domain-Name: Default Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Id: 3c3232bfea3b429697a9f4a4bfb3705a Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Name: admin Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: method: > Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: exception: Flavor 84 could not be found. Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: action_args: {'id': '84'} Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:40:01.811810 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:01.813138 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:01.814487 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-e0c7afc7-d927-4c9a-ad67-8c4182f364b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:40:01.815737 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-e0c7afc7-d927-4c9a-ad67-8c4182f364b7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011793 Aug 31 09:40:01.815737 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 31 09:40:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 09:40:02.772934 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-9ddf03f7-d870-43fc-a44a-451269779385 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:02.773958 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-9ddf03f7-d870-43fc-a44a-451269779385 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 09:40:02.774350 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:03.298132 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-9bf71055-efd0-4cd1-a48f-e034caa260c7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:03.303830 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.wsgi [None req-9bf71055-efd0-4cd1-a48f-e034caa260c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-9bf71055-efd0-4cd1-a48f-e034caa260c7 admin admin] Request method failure captured: Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Accept: application/json Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Accept-Encoding: gzip, deflate Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Connection: keep-alive Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Content-Length: 0 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Host: 10.222.0.25 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Openstack-Api-Version: compute 2.90 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Openstack-System-Scope: None Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: User-Agent: python-novaclient Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Auth-Token: gAAAAABjDyxyElwtALR1V0uFag56MesYzkwfGNJGEw4rnodZPzLrTtvosP7Mos82CYL7sQdXuD5ybcUdA7W7gY6XYMOw6Bu_e8eMH7Xd6exMKGu4GQfrT6ZVlPFFFVTFpsluC2_JMK2ddHdWRQf3GDU_DMDeyMh65CAUDHvVb4QLXZisdlzgPr8 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Domain-Id: None Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Domain-Name: None Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Identity-Status: Confirmed Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Is-Admin-Project: True Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Domain-Id: default Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Domain-Name: Default Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Project-Name: admin Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Role: reader,admin,member Aug 31 09:40:03.305338 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Roles: reader,admin,member Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_908a4dee0a684e749e89f40e4287b799", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant: admin Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-Tenant-Name: admin Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User: admin Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Domain-Id: default Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Domain-Name: Default Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Id: 3c3232bfea3b429697a9f4a4bfb3705a Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: X-User-Name: admin Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: method: > Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: exception: Flavor 451 could not be found. Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: action_args: {'id': '451'} Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:40:03.306664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:03.307511 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.309475 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-9bf71055-efd0-4cd1-a48f-e034caa260c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:40:03.310814 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-9bf71055-efd0-4cd1-a48f-e034caa260c7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395681 Aug 31 09:40:03.310814 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 31 09:40:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:03.317683 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-e23e2c09-5ef6-47c3-b1c0-358d680c3d2e admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:03.333714 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-e23e2c09-5ef6-47c3-b1c0-358d680c3d2e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019583 Aug 31 09:40:03.334257 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 31 09:40:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:40:03.344262 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:03.359499 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018755 Aug 31 09:40:03.360021 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 31 09:40:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:40:03.369224 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-183dcd1c-1257-43e4-a51f-118034cb88e9 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:03.376229 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.wsgi [None req-183dcd1c-1257-43e4-a51f-118034cb88e9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-183dcd1c-1257-43e4-a51f-118034cb88e9 admin admin] Request method failure captured: Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Accept: application/json Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Accept-Encoding: gzip, deflate Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Connection: keep-alive Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Content-Length: 0 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Host: 10.222.0.25 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Openstack-Api-Version: compute 2.90 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Openstack-System-Scope: None Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: User-Agent: python-novaclient Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Auth-Token: gAAAAABjDyxyElwtALR1V0uFag56MesYzkwfGNJGEw4rnodZPzLrTtvosP7Mos82CYL7sQdXuD5ybcUdA7W7gY6XYMOw6Bu_e8eMH7Xd6exMKGu4GQfrT6ZVlPFFFVTFpsluC2_JMK2ddHdWRQf3GDU_DMDeyMh65CAUDHvVb4QLXZisdlzgPr8 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Domain-Id: None Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Domain-Name: None Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Identity-Status: Confirmed Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Is-Admin-Project: True Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Domain-Id: default Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Domain-Name: Default Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Project-Name: admin Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Role: reader,admin,member Aug 31 09:40:03.378535 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Roles: reader,admin,member Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/908a4dee0a684e749e89f40e4287b799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_908a4dee0a684e749e89f40e4287b799", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant: admin Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant-Id: 908a4dee0a684e749e89f40e4287b799 Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-Tenant-Name: admin Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User: admin Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Domain-Id: default Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Domain-Name: Default Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Id: 3c3232bfea3b429697a9f4a4bfb3705a Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: X-User-Name: admin Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: method: > Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: exception: Flavor 451 could not be found. Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: action_args: {'id': '451'} Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:40:03.380170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:03.381170 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: ERROR nova.api.openstack.wsgi Aug 31 09:40:03.382452 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-183dcd1c-1257-43e4-a51f-118034cb88e9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:40:03.383941 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-183dcd1c-1257-43e4-a51f-118034cb88e9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014236 Aug 31 09:40:03.383941 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 31 09:40:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:04.341896 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:04.342840 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 31 09:40:04.343239 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:04.875264 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-f35c3374-0ff8-4e1a-ae37-6ff9c4626e51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:04.893664 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-f35c3374-0ff8-4e1a-ae37-6ff9c4626e51 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414704 Aug 31 09:40:04.894120 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 31 09:40:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:40:05.862655 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:05.863695 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 09:40:05.864093 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:06.390340 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-79269f8b-46b4-4e49-84b9-d0ec692d9d10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:06.408059 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-79269f8b-46b4-4e49-84b9-d0ec692d9d10 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406978 Aug 31 09:40:06.408596 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 31 09:40:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:07.383301 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:07.384377 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 09:40:07.384772 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:07.908525 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-dad801fb-1684-4dc4-8dd5-291c22ac5323 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:07.927865 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-dad801fb-1684-4dc4-8dd5-291c22ac5323 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406123 Aug 31 09:40:07.928407 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 31 09:40:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:08.894126 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:08.895191 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 09:40:08.895583 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:09.414582 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-d75fccb9-9093-4586-91aa-3284f4f4d7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:09.433729 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-d75fccb9-9093-4586-91aa-3284f4f4d7e6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399568 Aug 31 09:40:09.434304 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 31 09:40:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:10.390983 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:10.392004 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 09:40:10.392401 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:10.914436 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-5ff31eaa-4e34-4b57-9a4f-eba363e29078 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:10.935098 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-5ff31eaa-4e34-4b57-9a4f-eba363e29078 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403552 Aug 31 09:40:10.935561 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Aug 31 09:40:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:41:04.151835 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:04.152903 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-643020c2-a452-408f-b59f-ae9635aa9814 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 31 09:41:04.153348 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 31 09:41:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:04.163783 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:04.540116 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-fcb2c66e-bb4e-4370-bbf2-00b8384da0ea admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:04.561019 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-fcb2c66e-bb4e-4370-bbf2-00b8384da0ea admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401671 Aug 31 09:41:04.561554 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 31 09:41:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:04.582969 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG dbcounter [-] [117473] Writing DB stats nova_api:SELECT=14 {{(pid=117473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:04.586647 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-2e164e4e-2e0b-49c5-a3cc-5596420aac82 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:04.594870 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-2e164e4e-2e0b-49c5-a3cc-5596420aac82 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013302 Aug 31 09:41:04.595390 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Aug 31 09:41:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:04.606673 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-dcee2983-5f5f-4c89-b5bf-a14eaa2ae306 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:04.614085 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-dcee2983-5f5f-4c89-b5bf-a14eaa2ae306 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010971 Aug 31 09:41:04.614593 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Aug 31 09:41:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:04.625642 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:04.632995 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010837 Aug 31 09:41:04.633499 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Aug 31 09:41:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:04.644941 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-6954b955-62c1-457a-b65f-5ed073ff6b9a admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:04.652755 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-6954b955-62c1-457a-b65f-5ed073ff6b9a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011208 Aug 31 09:41:04.653282 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Aug 31 09:41:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:44:11.970455 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:11.971464 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 09:44:11.971890 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:44:12.113532 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_api:SELECT=6 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:44:12.270983 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:12.274559 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:12.275037 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:12.275468 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:12.276183 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:12.276622 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:12.277058 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:12.310626 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-557bc17d-4d32-49e2-9a97-29dda05803d5 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198621 Aug 31 09:44:12.311174 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 31 09:44:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:44:13.139664 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:13.140703 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 31 09:44:13.141136 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:44:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:44:13.330854 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:13.334291 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:13.334767 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:13.335193 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:13.335897 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:13.336343 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:13.336785 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:13.356858 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-8de4a6f4-6322-43c4-802a-711347026817 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076745 Aug 31 09:44:13.357477 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 31 09:44:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:44:24.591058 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:24.592060 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 31 09:44:24.592453 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:44:24.735127 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_cell0:SELECT=4 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:44:24.735842 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_cell1:SELECT=4 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:44:24.736666 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG dbcounter [-] [117474] Writing DB stats nova_api:SELECT=8 {{(pid=117474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:44:24.786447 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:24.790367 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:24.790842 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:24.791301 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:24.792017 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:24.792457 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:24.792871 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:24.818203 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-c493761a-5a10-43f1-abed-c03ab7260bb3 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087400 Aug 31 09:44:24.818766 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 31 09:44:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:44:25.638729 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: DEBUG nova.api.openstack.wsgi [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] Calling method '>' {{(pid=117473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:25.639729 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: INFO nova.api.openstack.requestlog [None req-1eef7536-68e4-46f6-b110-0f34fc211bf7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 31 09:44:25.640122 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: [pid: 117473|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 31 09:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:44:25.829138 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG nova.api.openstack.wsgi [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Calling method '>' {{(pid=117474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:44:25.832629 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:25.833147 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:25.833576 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:25.834334 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:44:25.834726 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:44:25.835139 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: DEBUG oslo_concurrency.lockutils [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:44:25.856686 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: INFO nova.api.openstack.requestlog [None req-44c327d7-dadc-4d6e-b7da-ddbfde7cf9c9 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080297 Aug 31 09:44:25.857262 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: [pid: 117474|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 31 09:44:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:45:31.082179 dv-cinder-837542-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 09:45:31.083069 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: Wed Aug 31 09:45:31 2022 - graceful shutdown triggered... Aug 31 09:45:31.083567 dv-cinder-837542-8-iscsi devstack@n-api.service[117473]: Gracefully killing worker 1 (pid: 117473)... Aug 31 09:45:31.090011 dv-cinder-837542-8-iscsi devstack@n-api.service[117474]: Gracefully killing worker 2 (pid: 117474)... Aug 31 09:45:32.083474 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: worker 1 buried after 1 seconds Aug 31 09:45:32.084019 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: worker 2 buried after 1 seconds Aug 31 09:45:32.084019 dv-cinder-837542-8-iscsi devstack@n-api.service[117472]: goodbye to uWSGI. Aug 31 09:45:32.085123 dv-cinder-837542-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 09:45:32.085686 dv-cinder-837542-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 09:45:32.088504 dv-cinder-837542-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 09:45:32.102062 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:45:32 2022] *** Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: nodename: dv-cinder-837542-8-iscsi Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: machine: x86_64 Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: clock source: unix Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: pcre jit disabled Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: detected number of CPU cores: 4 Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: current working directory: / Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:45:32.104684 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: your processes number limit is 47680 Aug 31 09:45:32.105592 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: your memory page size is 4096 bytes Aug 31 09:45:32.105592 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: detected max file descriptor number: 2048 Aug 31 09:45:32.105592 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: lock engine: pthread robust mutexes Aug 31 09:45:32.105592 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: thunder lock: enabled Aug 31 09:45:32.105592 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 09:45:32.105592 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:45:32.145569 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: Python main interpreter initialized at 0x555957f419c0 Aug 31 09:45:32.145569 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: python threads support enabled Aug 31 09:45:32.145569 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: your server socket listen backlog is limited to 100 connections Aug 31 09:45:32.145569 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:45:32.146017 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:45:32.146017 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: *** Operational MODE: preforking *** Aug 31 09:45:32.146293 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:45:32.146293 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: spawned uWSGI master process (pid: 132465) Aug 31 09:45:32.146502 dv-cinder-837542-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 09:45:32.148524 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: spawned uWSGI worker 1 (pid: 132478, cores: 1) Aug 31 09:45:32.148524 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: spawned uWSGI worker 2 (pid: 132479, cores: 1) Aug 31 09:45:32.148524 dv-cinder-837542-8-iscsi devstack@n-api.service[132465]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:45:32.841642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:45:32.843067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:45:34.004996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:45:34.004996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: from cryptography.utils import int_from_bytes Aug 31 09:45:34.005633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:45:34.005633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: from cryptography.utils import int_from_bytes Aug 31 09:45:34.032517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:45:34.032517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: from cryptography.utils import int_from_bytes Aug 31 09:45:34.033204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:45:34.033204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: from cryptography.utils import int_from_bytes Aug 31 09:45:36.470404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:45:36.471041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:45:36.471339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:45:36.471596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:45:36.471843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:45:36.472239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.472637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.473516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.473846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.474346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.474673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.475004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.475331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.475670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.475940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.476263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.476593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-8-iscsi {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.476920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.477261 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.477582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.477912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.478226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.478556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.478868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.479434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.480902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.480902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.480902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.481342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.481548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.481850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.482170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.482495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.482826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.483156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.483567 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-8-iscsi {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.483898 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.484224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.484524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.484996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.485313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.485622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.485942 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.486272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.486587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.486919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.487310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.487634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.487993 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.488375 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.488692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.489032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.489364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.489675 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.489984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.490240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.490552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.490879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.491206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.491535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.491796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.492049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.492376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.492706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.493039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.493355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.493671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.493983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.494292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.494596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.494925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.495222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.495552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.495871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.496204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.496517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.496845 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.497292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.497549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.497865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.498217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.498542 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.498858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.499185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.499536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.499899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.500214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.500527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.500854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.501222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.501536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.501791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.502092 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.502596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.503089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.503566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.504634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.505145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.505625 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.506112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.506579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.507046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.507529 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.508006 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.508482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.508950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.509459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.509932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.510426 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.510907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.511386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.511503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:45:36.511923 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:45:36.512288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:45:36.512538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.512662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:45:36.512895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:45:36.513297 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.513412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.513625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.513946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.514195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.514313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.514735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.514950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.515068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.515358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.515682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.515791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.516009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.516273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.516568 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.516679 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.516900 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-8-iscsi {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.517255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.517470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.517581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.517862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.518181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.518325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.518483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.518809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.518967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.519723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.519843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.520398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.520512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.520679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.520776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.520776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.520922 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.521135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.521231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.521457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.521560 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.521724 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.521816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.522189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.522316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.522408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.522490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.522848 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.523879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-8-iscsi {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.524038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.524181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.524399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.524524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.524622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.524898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.525938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.526121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.526247 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.526386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.526563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.526696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.526826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.526960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.527101 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.527220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.527349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.527481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.528220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.528370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.528493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.528605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.528605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.528862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.529013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.529145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.529328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.529476 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.529617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.529790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.530519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.530655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.530785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.531665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.531836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.531991 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.532144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.532441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.532605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.532760 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.532904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.533107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.533264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.533264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.533503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.533593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.533678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.533769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.533861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.533954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.534101 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.534228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.534362 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.534501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.534638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.534812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.535490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.535610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.535737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.535867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.536677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.536840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.536996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.537129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.540132 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.540319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.540482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.540643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.540643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.540937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.541116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.541270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.541603 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.541769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.541769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.541769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.541769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.542315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.542487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.542643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.542790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.542941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.543079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.543221 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.543372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.543519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.543663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.543804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.543943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.544080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.544231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.544388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.544536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.544677 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.544817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.545069 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.545239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.545385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.545527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.545751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.545894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.546052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.546540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.547194 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.547677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.547832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.547972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.548128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.548278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.548428 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.548574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.548720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.548871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.549083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.549247 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.549343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.549429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.549522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.549608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.549702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.549795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.549887 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.549972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.550056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.550140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.550237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.550372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.550534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.550667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.550795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.550937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.551071 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.551208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.551306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.551399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.551484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.551583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.551723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.551823 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.551926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.552013 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.552105 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.552190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.552388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.552480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.552572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.552657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.552797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.552887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.552997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.553097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.553184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.553281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.553377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.553470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.553563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.553648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.553788 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.553788 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.554051 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.554180 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.554309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.554406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.554546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.554649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.554743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.554835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.554921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.555011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.555111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.555204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.555296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.555382 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.555466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.555550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.555647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.555781 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.555871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.555956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.556087 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.556183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.556277 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.556409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.556546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.556636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.556721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.556805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.556947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.557102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.557203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.557297 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.557389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.557489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.557575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.557667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.557812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.557909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.558002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.558101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.558195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.558280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.558364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.558447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.558538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.558638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:45:36.558732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.558823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.558918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.559936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560737 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.560924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561124 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.561897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.562111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.562215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.562428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.562529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.562746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.562849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.563061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.563164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.563386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.563486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.563701 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.563804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.564010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.564108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.564325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.564423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.564654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.564756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565311 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565619 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.565928 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.566020 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.566274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.566369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.566586 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.566730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.566910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.567051 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.567241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.567344 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.567552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.567651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.567867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568009 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568178 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.568896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.569133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.569244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.569443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.569544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.569755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.569848 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.570065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.570171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.570634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.570733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.570957 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.571982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.572203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.572303 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.572513 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.572608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.572821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.572924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.573155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.573264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.573458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.573558 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.573763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.573888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574364 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.574995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.575144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.575882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.576045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.576197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.576358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.576575 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.576729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.576873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.577925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578062 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578504 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578656 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.578935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579246 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.579928 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580504 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580640 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.580950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.581149 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.581285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.581461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.581595 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.582291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.582442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.582645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.582740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.582961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.583055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.583272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.583402 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.583593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.583695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.583921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584558 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.584985 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.585217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.585310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.585524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.585623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.585828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.585929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.586135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.586235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.586436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.586582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.586744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.586887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.587937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.588038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.588238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.588334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.588556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.588668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.588862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.589028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.589189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.589292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.589492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.589594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.589792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.590076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.590176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.590421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.590522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.590741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.590834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.591067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.591168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.591387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.591485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.591710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.591853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592740 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.592994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.593113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.593292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.593427 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.593600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.593691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.593903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594007 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594312 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.594977 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.595137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.595227 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.595448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.595559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.595754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.595847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.596057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.596155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.596359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.596457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.596664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.596765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.597000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.597139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.597312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.597451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.598180 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.598282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.598489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.598591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.598807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.598897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.599119 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.599212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.599425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.599523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.599733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.599838 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.600039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.600138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.600358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.600453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.600667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.600773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601003 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.601946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602087 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.602975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.603187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.603293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.603495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.603702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.603797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.603884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.604111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.604212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.604419 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.604512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.604723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.604822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605366 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605670 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.605976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606588 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.606998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.607201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.607339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.607503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.607599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.607804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.607911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.608106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.608197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.608408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.608502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.608710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.608811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.609966 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610282 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.610977 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.611195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.611296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.611498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.611589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.611799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.611898 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.612102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.612194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.612404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.612505 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.612713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.612803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.613085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.613200 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.613394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.613569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.613709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.613882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.614957 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.615164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.615265 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.615480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.615572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.615789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.615880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.616098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.616198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.616403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.616495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.616717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.616886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617662 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.617968 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618577 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.618970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.619185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.619283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.619489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.619590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.619795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.620055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.620156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.620388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.620491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.620703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.620806 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.621106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.621316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.621412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.621561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.621712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.621842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622022 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622350 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622732 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.622942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623384 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623560 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.623977 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.624164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.624287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.624465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.624575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.624768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.624874 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.625095 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.625214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.625406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.625523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.625707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.625802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626015 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626316 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626711 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.626925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.627027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.627226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.627330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.627537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.627660 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.627844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.628867 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.629086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.629196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.629391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.629490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.629731 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.629832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630033 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.630963 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.631057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.631292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.631392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.631592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.631689 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.631901 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632000 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.632895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.633132 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.633237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.633438 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.633572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.633737 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.633890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.634970 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.635154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.635272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.635474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.635576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.635792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.635892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.636102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.636195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.636465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.636564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.636769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.636870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.637096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.637203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.637408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.637516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.637716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.637839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.638931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639034 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639626 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.639936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.640143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.640280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.640449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.640558 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.640750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.640908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.641097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.641252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.641408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.641566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.641712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.641992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.642094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.642309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.642401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.642610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.642714 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.642911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643012 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643854 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.643956 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.644157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.644794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645650 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.645956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646375 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.646972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.647168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.647302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.647468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.647623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.647770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.647960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.648092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.648398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.648519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.648687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.648825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.649964 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.650068 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.650272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.650408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.650594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.650718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.650903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.651924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.652134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.652244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.652434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.652536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.652748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.652897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.653093 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.653200 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.653405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.653498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.653704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.653804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654005 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.654943 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.655050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.655264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.655365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.655570 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.655663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.655894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.656903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.657141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.657235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.657449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.657557 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.657755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.657850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658684 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.658990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.659101 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.659297 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.659392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.659601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.659705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.659959 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.660618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.660767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.660869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.661106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.661203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.661432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.661526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.661739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.661834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662350 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.662952 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663680 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.663992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.664177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.664304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.664505 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.664600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.664819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.664931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.665172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.665283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.665489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.665592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.665802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.665904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.666119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.666228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.666417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.666512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.666765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.666866 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.667071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.667195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.667391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.667528 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.667702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.667794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668004 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668099 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.668942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.669117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.669281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.669373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.669599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.669712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.669919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.670965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.671181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.671283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.671501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.671603 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.671941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.672036 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.672253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.672346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.672564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.672671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.672886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673558 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.673968 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.674188 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.674285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.674487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.674582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.674810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.674912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.675133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.675236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.675459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.675557 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.675781 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.675883 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.676089 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.676187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.676413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.676516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.676735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.676829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.677073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.677185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.677395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.677525 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.677717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.677819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.678081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.678236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.678402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.678548 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.678716 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.678817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679640 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.679946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.680048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.680263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.680363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.680587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.680688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.680907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681551 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681662 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.681955 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.682168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.682270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.682470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.682574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.682774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.682868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.683130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.683239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.683464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.683576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.683768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.683872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.684078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.684170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.684399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.684595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.684702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.684915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.685055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.685278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.685383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.685609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.685711 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.685935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.686977 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.687181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.687283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.687489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.687628 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.687808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.687909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.688126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.688233 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.688433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.688533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.688758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.688891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.689100 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.689250 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.689412 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.689580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.689736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.689886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.690042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.690185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.690327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.690610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.690755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.690920 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.691093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.691236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.691471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.691625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.691811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.691963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.692113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.692255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.692404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.692546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.692694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.692847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693409 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693727 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.693941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694250 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.694951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.695158 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.695513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.695730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.695837 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.696038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.696131 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.696353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.696448 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.696660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.696763 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.697932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.698986 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.699184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.699315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.699470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.699615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.699778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.699870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.700082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.700189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.700393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.700485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.700703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.700914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.701074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.701291 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.701386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.701606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.701700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.701918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702019 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702636 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.702958 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.703166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.703270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.703477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.703571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.703786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.703894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.704093 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.704190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.704406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.704498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.704728 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.704835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.705076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.705178 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.705413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.705659 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.705754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.705999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.706101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.706323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.706426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.706635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.707242 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.707498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.707591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.707811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.707910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.708118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.708226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.708424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.708564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.708735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.708865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.709081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.709175 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.709393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.709484 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.709701 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.709842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.710941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.711976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.712199 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.712306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.712515 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.712619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.712823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.712915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.713160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.713263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.713476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.713587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.713819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.713991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.714145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.714303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.714466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.714637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.714792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.714959 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.715113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.715281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.715427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.715596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.715740 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.715912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.716052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.716240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.716364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.716550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.716683 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.716853 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.717041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.717197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.717359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.717506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.717667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.717812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.718089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.718200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.718406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.718501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.718719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.718821 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.719036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.719140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.719342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.719445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.719663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.719939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.720035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.720283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.720377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.720646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.720755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.720912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.721998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.722215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.722310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.723080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.723186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.723389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.723597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.723698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724006 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724613 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724763 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.724924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.725107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.725243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.725422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.725545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.725732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.725834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726362 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.726985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.727081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.727295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.727399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.727602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.727724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.727906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728513 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.728925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.729146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.729255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.729449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.729550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.729761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.729940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.730973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.731067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.731281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.731418 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.731616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.731721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.731918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732223 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732538 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.732970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.733264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.733358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.733578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.733681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.733890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.733983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.734237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.734331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.734556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.734653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.734871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.735085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.735213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.735422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.735530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.735745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.735840 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.736079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.736182 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.736413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.736508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.736726 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.736829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.737055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.737165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.737362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.737457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.737685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.737779 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.738956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.739067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.739266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.739370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.739574 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.739705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.739885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740813 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.740920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.741151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.741244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.741459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.741553 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.741766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.741870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.742077 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.742172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.742388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.742487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.742708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.742794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743438 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.743969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.744064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.744277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.744371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.744585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.744687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.744893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745643 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.745963 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.746177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.746280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.746484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.746579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.746809 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.746902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.747054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:45:36.747199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.747517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.747835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.748142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.748463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.748783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.749119 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.749440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.749750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.750078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.750420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.750749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.751074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.751377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.751811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.752005 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.752315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.752632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.752943 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.753269 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.753572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.754392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.754696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.754997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.755299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.755601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.757630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.758168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.758262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.758522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.758822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.759126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.759426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.759792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.760094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.760409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.760926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.763420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.764087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.764213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.764523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.764832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.765169 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.765480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.765998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.766326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.766632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.766958 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.767278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.767597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.767911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.768218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.768546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.768857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.769207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.769721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.770033 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.770344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.770659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.770969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.771279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.771596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.772156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.772488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.772812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.773146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.773472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.773799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.774150 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.774462 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.774805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.775130 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.775441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.775748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.776048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:45:36.776290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:45:36.813180 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO dbcounter [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Registered counter for database nova_api Aug 31 09:45:36.833703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_db.sqlalchemy.engines [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:36.837838 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO dbcounter [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Registered counter for database nova_api Aug 31 09:45:36.840237 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writer thread running {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:36.860848 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_db.sqlalchemy.engines [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:36.868079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writer thread running {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:36.897843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.context [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da05a9a-2a4d-4b28-8333-0debf927f427(cell1) {{(pid=132479) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:45:36.901897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:36.902381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:36.903972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:36.904699 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:36.905185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:36.907187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:36.909210 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO dbcounter [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Registered counter for database nova_cell0 Aug 31 09:45:36.913754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO dbcounter [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Registered counter for database nova_cell1 Aug 31 09:45:36.921051 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_db.sqlalchemy.engines [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:36.922347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_db.sqlalchemy.engines [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:36.924515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.context [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da05a9a-2a4d-4b28-8333-0debf927f427(cell1) {{(pid=132478) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:45:36.929004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writer thread running {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:36.929254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:36.929743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:36.931348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:36.931532 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writer thread running {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:36.932091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:36.932548 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:36.934586 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:36.936606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO dbcounter [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Registered counter for database nova_cell0 Aug 31 09:45:36.940624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO dbcounter [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Registered counter for database nova_cell1 Aug 31 09:45:36.949745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_db.sqlalchemy.engines [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:36.950999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_db.sqlalchemy.engines [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:36.958010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writer thread running {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:36.959221 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writer thread running {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:37.084134 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO dbcounter [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Registered counter for database nova_cell0 Aug 31 09:45:37.093626 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_db.sqlalchemy.engines [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:37.104545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writer thread running {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:37.114044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO dbcounter [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Registered counter for database nova_cell0 Aug 31 09:45:37.122353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_db.sqlalchemy.engines [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:45:37.126980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writer thread running {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:45:37.436730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: WARNING keystonemiddleware.auth_token [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:45:37.444803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: WARNING keystonemiddleware.auth_token [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:45:37.459498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: WARNING keystonemiddleware.auth_token [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:45:37.466764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: WARNING keystonemiddleware.auth_token [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:45:37.797712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: WARNING keystonemiddleware.auth_token [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:45:37.804334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: WARNING keystonemiddleware.auth_token [None req-87e0092a-c273-4bc4-87fa-8c63ea585a72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:45:37.809733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555957f419c0 pid: 132479 (default app) Aug 31 09:45:37.813116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: WARNING keystonemiddleware.auth_token [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:45:37.819166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: WARNING keystonemiddleware.auth_token [None req-27168a6b-1820-458f-a32b-1d777cde0641 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:45:37.824836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555957f419c0 pid: 132478 (default app) Aug 31 09:46:20.402715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:20.403858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:20.405092 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:20.406201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:20.967440 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-631667869", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "networks": [{"uuid": "9a2fd03d-da80-43be-9a53-ef4e7f627be5"}]}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:21.490251 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] validate_networks() for [('9a2fd03d-da80-43be-9a53-ef4e7f627be5', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:46:24.060324 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:46:24.060928 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:46:24.061665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:46:24.062144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:46:24.062675 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:46:24.106888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:24.127152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:24.128197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:24.130300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:24.130979 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:24.131957 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:24.220441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Getting quotas for project 3f3531fb48774df8a26ee722f3eb837e. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:24.239229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Getting quotas for user 5b9f29fab9e24e98a632416f2160182c and project 3f3531fb48774df8a26ee722f3eb837e. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:24.273145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:46:24.279551 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:46:24.449431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8d4eac2f-2323-4853-8dc0-950a38543466 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.062175 Aug 31 09:46:24.458846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:46:25.067714 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-acd83360-342d-4df0-bda8-76c6afcafa5a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:25.075652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-acd83360-342d-4df0-bda8-76c6afcafa5a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:25.094051 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.097685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.101408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.105687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.950289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-acd83360-342d-4df0-bda8-76c6afcafa5a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:25.990698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-acd83360-342d-4df0-bda8-76c6afcafa5a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1214 microversion: 2.1 time: 1.528228 Aug 31 09:46:25.993020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:24 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1214 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:27.018960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:27.019608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:27.052367 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:27.054190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:27.055950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:27.061725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:27.063506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:27.064188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:27.511008 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:27.542639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d5cbc97e-0f72-4027-b531-fac3e977e339 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1218 microversion: 2.1 time: 0.524367 Aug 31 09:46:27.543832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:27 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1218 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:28.564728 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:28.565547 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:28.581465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:28.581465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:28.581465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:28.582231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:28.583847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:28.599849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:29.698040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:29.770403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-20ac6487-02c2-48b8-9eb9-e947fc36c669 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1284 microversion: 2.1 time: 1.210049 Aug 31 09:46:29.801865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:28 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1284 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:30.489638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-48a2a831-d43d-4130-977e-aaddc616b8f2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'create', calling method: .version_select at 0x7f0b52ce7c10>, body: {"keypair": {"name": "tempest-keypair-1502316576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOppSp9ZJrGmSJzQ7nc/FrSYsBhK6nCnfNNEx5D+kb4gqrEIdaJdJhGQwqrw+diRQ+JwxeOsfkGw7BI90OUVLYBY+/iP3MGxers+k4P0iU8LghtG2/+RiaLHUj4tBU4aGw=="}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:30.583830 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-48a2a831-d43d-4130-977e-aaddc616b8f2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for project d16af15e86174ab1b9344d35ffe0844d. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:30.603222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-48a2a831-d43d-4130-977e-aaddc616b8f2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for user 468522570ba7419c87da6d05fc0d1ff1 and project d16af15e86174ab1b9344d35ffe0844d. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:30.715000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-48a2a831-d43d-4130-977e-aaddc616b8f2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.491393 Aug 31 09:46:30.723633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 3/5] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Aug 31 09:46:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 501 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 09:46:30.812516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:30.813432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:30.848593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:30.849491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:30.850187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:30.851286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:30.871473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:30.874151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:31.445403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:31.494277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ddaee164-3682-4e88-9cbb-f0da647bf4b3 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1272 microversion: 2.1 time: 0.681476 Aug 31 09:46:31.509837 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:30 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1272 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:32.533939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:32.534976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:32.575002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:32.578081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:32.579145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:32.583670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:32.586826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:32.588989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:33.214880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:33.240846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ed1a76bb-c2bc-4c69-b597-308ec386846e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1272 microversion: 2.1 time: 0.714067 Aug 31 09:46:33.241716 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:32 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1272 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:34.274803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:34.275642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:34.297465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:34.302026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:34.302553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:34.309765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:34.310316 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:34.310809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:35.963372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:35.976821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9737a22e-2895-4ab1-b278-13ff7ae8cdef tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 1.706564 Aug 31 09:46:35.980995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:34 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:36.999649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:37.001155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:37.003658 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:37.019370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:37.029726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:37.030614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:37.035505 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:37.037773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:37.039993 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:37.245841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:38.040118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1894496509", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:38.218360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:38.237789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ed6e3dfb-ed5b-4e7b-a491-39ac5fc30a51 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 1.239898 Aug 31 09:46:38.240405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:36 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:38.433432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] validate_networks() for [('b7ee7ccc-0c6c-4664-a1eb-32f4b3ca2837', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:46:39.260151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:39.260782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:39.271871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:39.278069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:39.278584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:39.282199 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:39.282905 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:39.285306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:40.169652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:40.194840 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-000032e6-42a0-468c-b7cc-7510d346c1ec tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.935738 Aug 31 09:46:40.216124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:39 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:40.617266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=10 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:40.785114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7b0cf837-7758-4f54-b446-da9e999af7df tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: .version_select at 0x7f0b52c5ca60>, body: {"keypair": {"name": "tempest-keypair-661434089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzYIaJxoXNMzLAxpF6BMxLOaiuctg2uZ5we1IgV0SDkbm60mQKqck3g2dGvunpEcSluQPM05+5pHBZH/KgG83gqk5KeHG4jpu1Celb2XX0wBuh/2OycMstdjsP7N5lFHA=="}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:40.861517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-7b0cf837-7758-4f54-b446-da9e999af7df tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:40.877102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-7b0cf837-7758-4f54-b446-da9e999af7df tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for user a0101b6f23d04016a89c986621ba5dde and project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:40.943215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7b0cf837-7758-4f54-b446-da9e999af7df tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.722650 Aug 31 09:46:40.946139 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 7/11] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:46:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:41.911578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d722506d-0718-42cc-a06c-256c8758acaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: .version_select at 0x7f0b52c07160>, body: {"keypair": {"name": "tempest-keypair-1362967216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOFu8xqEVyuO3dQkfkaazHVBJUZg+f6Dzy5M8b9DOJsxIx1qb8BwQk7GAvm3FPG7Z7+Fc6zn0C4QC9QegyU6oWi2WgpKnObz5ze3hqvJBk5kZrNiFkJ3gegFvatFB+iOQ=="}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:41.997276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-d722506d-0718-42cc-a06c-256c8758acaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:42.013414 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-d722506d-0718-42cc-a06c-256c8758acaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:42.106606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d722506d-0718-42cc-a06c-256c8758acaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.158200 Aug 31 09:46:42.115615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 8/12] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:46:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:42.128311 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:42.129647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:42.160729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:42.162751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:42.164566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:42.166025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:42.171885 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:42.174005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:42.685631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:42.703645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1310b61a-721a-4b23-85d6-3c4b1233a38f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.584918 Aug 31 09:46:42.706071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 9/13] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:42 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:42.818095 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:46:42.819820 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:46:42.820540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:46:42.821157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:46:42.821971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:46:42.867828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:42.876008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:42.878581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:42.879697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:42.883262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:42.883902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:42.962475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for project 089a845bce2542969b7e6f013b28d928. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:42.977501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for user 79acdbc2c11c4459928eab5b83a6755d and project 089a845bce2542969b7e6f013b28d928. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:43.005296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:46:43.014786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:46:43.207282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-241108eb-b985-45c6-b81d-c1974aad2c61 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.963238 Aug 31 09:46:43.215393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 5/14] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:46:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 5973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:46:43.238058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795721537", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69822186-16f7-448b-8ff0-bb87c58671c7"}], "security_groups": [{"name": "tempest-securitygroup--267309524"}], "key_name": "tempest-keypair-1502316576", "user_data": "}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:43.450013 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc5c963-21d3-40d1-9e50-7ea8bd737dc1", "tag": "f6b2dd7f-fff8-4a07-910d-50ac5cbd3de0"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:43.542149 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:43.542709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:43.543243 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:43.568255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] validate_networks() for [('69822186-16f7-448b-8ff0-bb87c58671c7', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:46:43.634920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Creating event network-changed:f6b2dd7f-fff8-4a07-910d-50ac5cbd3de0 for instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 on hv-cinder-83754 Aug 31 09:46:43.638705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 09:46:43.643908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d15355dc-4b2d-4a25-8283-53bd4e540fc8 req-5eb792eb-63b0-4d52-9af2-3e3ae1e8cebd service nova] Acquired lock "compute-rpcapi-router" {{(pid=132479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 09:46:43.649103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:43.652836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:43.655194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:43.656231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:43.660456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:43.662466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:43.723426 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.compute.rpcapi [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 09:46:43.726605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] Releasing lock "compute-rpcapi-router" {{(pid=132479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 09:46:43.773540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ca9fd4b4-6885-4fab-8fa4-27618840fe39 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.062858 Aug 31 09:46:43.776304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 10/15] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:43.788492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7adff845-e571-4000-bf41-da972e52a1e8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:43.792604 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7adff845-e571-4000-bf41-da972e52a1e8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:44.140422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7adff845-e571-4000-bf41-da972e52a1e8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:44.179939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7adff845-e571-4000-bf41-da972e52a1e8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1222 microversion: 2.1 time: 0.395879 Aug 31 09:46:44.183090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 11/16] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:43 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1222 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:44.218961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:44.220928 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:44.252050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:44.254849 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:44.256798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:44.260076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:44.260553 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:44.262281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:44.752907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:44.765719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8aacd353-3065-4c28-b6d1-697a9a6257a9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.581353 Aug 31 09:46:44.766398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 12/17] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:44 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:44.792671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-669203214", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:45.004822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] validate_networks() for [('b7ee7ccc-0c6c-4664-a1eb-32f4b3ca2837', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:46:46.272019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:46:46.272559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:46:46.272907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:46:46.273343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:46:46.273755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:46:46.291155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:46.294443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:46.301631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:46.306996 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:46.308012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:46.310446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:46.392500 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for project d16af15e86174ab1b9344d35ffe0844d. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:46.419764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for user 468522570ba7419c87da6d05fc0d1ff1 and project d16af15e86174ab1b9344d35ffe0844d. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:46.473496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:46:46.481399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:46:46.638931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bb2f435a-8877-47d8-a6a9-6dc02ebb2dba tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.412344 Aug 31 09:46:46.644349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 6/18] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Aug 31 09:46:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 3421 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 09:46:46.667087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:46.667732 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:46.690513 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:46.691153 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:46.691481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:46.692212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:46.692678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:46.699643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:46.857333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:46:46.857916 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:46:46.858236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:46:46.859082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:46:46.859776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:46:46.905691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:46.906197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:46.906642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:46.907952 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:46.908411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:46.908841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:47.007422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for project 089a845bce2542969b7e6f013b28d928. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:47.008926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:47.019751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2fba2b39-68f4-47e3-9848-84d08fca376f tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.369580 Aug 31 09:46:47.026231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 7/19] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:46 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:47.027985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for user 79acdbc2c11c4459928eab5b83a6755d and project 089a845bce2542969b7e6f013b28d928. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:47.032454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-661ab76e-5bc6-4007-a8e1-b570fa62b190 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:47.040211 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-661ab76e-5bc6-4007-a8e1-b570fa62b190 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:47.087692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:46:47.090063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:46:47.192489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-661ab76e-5bc6-4007-a8e1-b570fa62b190 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:47.206272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-661ab76e-5bc6-4007-a8e1-b570fa62b190 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:47.208805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-661ab76e-5bc6-4007-a8e1-b570fa62b190 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:47.215273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-661ab76e-5bc6-4007-a8e1-b570fa62b190 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1282 microversion: 2.20 time: 0.182572 Aug 31 09:46:47.215954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 8/20] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:47 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:47.251492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8af38da5-b283-4162-a7c0-72074c6bc2f3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.464152 Aug 31 09:46:47.255502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 13/21] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:46:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:46:47.263424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9c5fd3de-9705-42cb-ad56-5f06be31cd80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:47.264274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9c5fd3de-9705-42cb-ad56-5f06be31cd80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:47.363391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c5fd3de-9705-42cb-ad56-5f06be31cd80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:47.378664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9c5fd3de-9705-42cb-ad56-5f06be31cd80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1221 microversion: 2.1 time: 0.119044 Aug 31 09:46:47.381392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 9/22] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:47 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:48.041553 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:48.042920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:48.072401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:48.072824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:48.073298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:48.093145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:48.094127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:48.095467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:48.240039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:48.241456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:48.247919 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:48.270531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:48.275654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:48.283460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:48.287735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:48.291068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:48.527587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:48.552118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:48.561186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:48.565681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-da4bcd8f-2542-4dbd-be05-c366c8fe492a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1278 microversion: 2.20 time: 0.329710 Aug 31 09:46:48.569041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 10/23] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:48 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1278 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:48.586883 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:48.587628 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:48.596875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:48.599006 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:48.599794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:48.601745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:48.603060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:48.604591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:48.753154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:48.761074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-615f527f-e379-4bdc-aa8a-1c64d069dbd9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.188720 Aug 31 09:46:48.761667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 11/24] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:48 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:48.970671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:48.980148 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-50497b3a-1ef7-4082-a522-a9e996bffa73 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.943180 Aug 31 09:46:48.983084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:48 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:49.008504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1405072878", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4ac3a0a-2c56-408a-aeab-d333315fe587"}], "security_groups": [{"name": "tempest-securitygroup--2028516718"}], "key_name": "tempest-keypair-661434089", "user_data": "}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:49.148750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] validate_networks() for [('d4ac3a0a-2c56-408a-aeab-d333315fe587', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:46:49.592755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:49.593744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:49.605196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:49.606381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:49.607319 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:49.608191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:49.609111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:49.611017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:49.724720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:49.736262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:49.738461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:49.742881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5317ccfe-7d98-4959-b08e-1641a2f1f3f8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.154492 Aug 31 09:46:49.744415 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:46:49.760052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 15/26] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:49 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:49.760052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-747587625", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e"}], "security_groups": [{"name": "tempest-securitygroup--438595546"}], "key_name": "tempest-keypair-1362967216", "user_data": "}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:46:49.764663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:46:49.765224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:46:49.765807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:46:49.766915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:46:49.779829 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:49.780691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:49.781498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:49.783711 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:49.785115 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:49.785775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:49.818782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:49.824280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for user a0101b6f23d04016a89c986621ba5dde and project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:49.841086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:46:49.845675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:46:49.935665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e8362261-e161-4339-8db9-0457e1654f89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.933082 Aug 31 09:46:49.942931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 12/27] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:46:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:46:49.949143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:49.950001 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:49.958510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:49.959257 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:49.959905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:49.961270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:49.973891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:49.974471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:49.998027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] validate_networks() for [('4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:46:50.109072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.124783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-02bde145-c441-482a-a42b-93e4e8011cab tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.180054 Aug 31 09:46:50.128209 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 13/28] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:49 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:50.139612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-999f7457-bb84-4750-be08-29a6251b1a19 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:50.142412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-999f7457-bb84-4750-be08-29a6251b1a19 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:50.218906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-999f7457-bb84-4750-be08-29a6251b1a19 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.227028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-999f7457-bb84-4750-be08-29a6251b1a19 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1237 microversion: 2.1 time: 0.097624 Aug 31 09:46:50.240914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:50 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:50.246714 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:50.247347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:50.259054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:50.259555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:50.260002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:50.260707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:50.273869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:50.274343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:50.546700 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.556114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-130eed4b-789d-4ab0-ad27-f48ea87aa9ac tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.327090 Aug 31 09:46:50.557387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:50 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:50.722333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:46:50.722895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:46:50.723228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:46:50.724078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:46:50.724509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:46:50.726705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:50.737152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:50.737885 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:50.738635 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:50.739919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:50.740865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:50.741647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:50.752992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=57 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:50.767215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:46:50.770550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:50.771875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:50.772225 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:46:50.779115 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:50.781465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:50.783046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:50.788503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:50.788665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:46:50.789431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:50.790097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:50.791724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:46:50.850057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fed977cf-dc20-48a5-9fc1-9b0a0d137007 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.103778 Aug 31 09:46:50.851280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 16/31] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:46:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:46:50.863774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-67558ab4-6c11-491d-9fcd-28550c1b4462 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:50.864655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-67558ab4-6c11-491d-9fcd-28550c1b4462 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:50.897066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.906390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.909421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.910723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-29b13489-a851-4634-a636-d49a237688ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.145950 Aug 31 09:46:50.911368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 16/32] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:50 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:46:50.937313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-67558ab4-6c11-491d-9fcd-28550c1b4462 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:50.948722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-67558ab4-6c11-491d-9fcd-28550c1b4462 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1241 microversion: 2.1 time: 0.089896 Aug 31 09:46:50.949810 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:50 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:51.148884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:51.149549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:51.159668 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.161253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.161718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.164076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.164558 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.166919 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.249000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:51.249576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:51.257236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:51.265617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.269989 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-74df9bbe-1c8d-4e7b-83a8-b338f9225863 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.124659 Aug 31 09:46:51.270713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.271520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.272456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.273846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 17/34] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:51 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:51.287304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.288007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.377793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:51.386564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-51505a6e-f6b2-4c3c-9ad3-1fb1f04dbe37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.142179 Aug 31 09:46:51.388203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:51 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:51.578166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:51.579033 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:51.585870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.586355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.586786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.587532 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.588149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.588614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.751966 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:51.760911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3cb37386-2c77-433f-b179-06c4692a8fd2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.187330 Aug 31 09:46:51.761925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 18/36] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:51 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:51.934807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:51.936155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:51.946083 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.946588 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.947029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.949026 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.949538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.950182 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:51.972927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:51.978721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:51.990052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:51.998117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:51.999498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.000655 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.003027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.003717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.078403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.096373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.098190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.100416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ccb5d924-bf2b-4828-9125-d1b404ade9af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.170061 Aug 31 09:46:52.101810 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:51 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:52.135785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.145134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5800ab8e-3ef9-465c-83ec-ee301024e1a8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.178559 Aug 31 09:46:52.149102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 19/38] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:51 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:52.295591 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:52.296211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:52.304852 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.305933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.310611 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.311383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.312028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.312646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.396057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.409655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9cde7b99-07b6-4aa0-bf06-2c9a02311584 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.117757 Aug 31 09:46:52.410328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:52 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:52.411342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:52.411962 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:52.429827 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.431911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.432602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.433589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.440369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.441052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.510474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.520133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-56131446-c6a2-444c-9bd1-44413bef8276 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.113722 Aug 31 09:46:52.520872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:52 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:46:52.780861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:52.781517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:52.788497 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.789008 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.789814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.793946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:52.794594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:52.795106 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:52.938577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:52.951090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7feab22b-e0ea-4c38-842c-3a64a341f51a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.173881 Aug 31 09:46:52.951973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 21/41] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:52 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:53.126898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:53.128202 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:53.134391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.135358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.135797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.136733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.137372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.137871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.166674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:53.167778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:53.174552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.175451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.176238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.177447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.178144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.178797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.243525 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:53.252112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-efd3cdbe-c1e7-4b7a-9b7f-4a9ebf051250 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.089580 Aug 31 09:46:53.252710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:53 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:46:53.358389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:53.367869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:53.369795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:53.371161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-830a0f9f-5386-4b65-a33d-a1026c6e0198 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.249804 Aug 31 09:46:53.372283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 21/43] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:53 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:53.431845 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:53.432511 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:53.443222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.445530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.446401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.448041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.448988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.450620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.544947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:53.545778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:53.546420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:53.557181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-36971ed1-5118-4169-b426-3d7ccf687f49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.129235 Aug 31 09:46:53.558356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 23/44] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:53 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:53.594657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.595107 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.595549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.598614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.599255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.600246 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.690076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:53.703662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c705f290-c33b-4db4-84fe-bbb670ee551e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.162215 Aug 31 09:46:53.706161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 22/45] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:53 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:53.977410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:53.978080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:53.985471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.986646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.987270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:53.988167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:53.988794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:53.989509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.174268 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.183643 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-da98995b-61a7-4cd2-a076-149d34d2b340 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.213575 Aug 31 09:46:54.184850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 24/46] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:53 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:54.277541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:54.279393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:54.288703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:54.291096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.291616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.292185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.292925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.293461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.293932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.329507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:54.394356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.399246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:54.400449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:54.406523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-05c07954-a6a5-47c0-9250-01da10dfe6f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.136131 Aug 31 09:46:54.408486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 23/47] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:54 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:46:54.416157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.417571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.418421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.419543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.420500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.422890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.506191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.516932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.519997 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.521390 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6d0e26ee-9158-44ce-a8e4-176bc5b31e5c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.126682 Aug 31 09:46:54.525091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 25/48] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:54 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:54.581252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:54.582408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:54.589770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.590285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.591154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.591848 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.592325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.593604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.690285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.699171 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a9e127f7-adec-4b78-bef8-91684f90c2ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.123942 Aug 31 09:46:54.699774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 24/49] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:54 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:54.733090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:54.734300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:54.742989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.743654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.744225 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.745109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:54.745508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:54.745933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:54.819032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:54.827967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2f7899a2-8694-44d7-8bd3-473f955c931e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.102324 Aug 31 09:46:54.829387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 26/50] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:54 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:55.206200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:55.206801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:55.215458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.215959 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.216678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.217122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.217583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.218008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.379046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.387686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-104a3f26-84df-4b62-98c7-c8555f8d3885 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.186529 Aug 31 09:46:55.388266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 25/51] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:55 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:55.429489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:55.430110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:55.445492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.445995 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.446433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.447168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.447773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.448233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.525861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.534862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8465dd3c-5345-439e-93c7-f13f1fc0e466 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.109094 Aug 31 09:46:55.537423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 27/52] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:55 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:55.553418 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:55.554090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:55.561940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.562635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.563102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.564389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.564980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.565418 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.634332 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.644537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.647181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.648527 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3bc93f5f-4afc-4a07-bf96-d9f49dc94018 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.100785 Aug 31 09:46:55.649402 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 26/53] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:55 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:46:55.724164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:55.724769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:55.730696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.731212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.731617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.732298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.732745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.733192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.797208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.808253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d84f336a-f034-4923-a210-9203177167e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.087884 Aug 31 09:46:55.809089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:55 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:55.849998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:55.850904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:55.857561 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.858048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.858495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.859221 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:55.860187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:55.860622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:55.971449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:55.979862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dce25885-f8b7-4ca9-9089-db88ec8ea519 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.133838 Aug 31 09:46:55.980436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 27/55] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:55 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:56.408189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:56.408807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:56.414728 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.415218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.415656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.416348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.416804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.417256 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.552702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:56.560424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:56.561542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:56.561708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8625ace8-c760-43ef-b3f6-7086043503d9 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.157994 Aug 31 09:46:56.570123 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 29/56] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:56 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:56.570279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.570279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.570279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.570279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.570553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.570553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.630901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:56.638531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e6c48564-8fbd-4fe3-a485-a2445252f574 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.081826 Aug 31 09:46:56.639087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 28/57] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:56 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:46:56.671168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:56.671773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:56.678084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.678564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.678992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.679699 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.680169 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.680594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.743794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:56.751998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:56.753463 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:56.754555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0f14e1ba-8a94-4125-8d67-392a2445a20d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.087270 Aug 31 09:46:56.755114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 30/58] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:56 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:56.830467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:56.831066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:56.837415 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.837897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.838490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.839200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:56.839651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:56.840069 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:56.906132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:56.915649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-99041f77-b622-4d59-98c2-a312bfaceaa1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.089464 Aug 31 09:46:56.916213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:56 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:57.002456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:57.003072 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:57.008986 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.009487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.009926 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.010646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.011110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.011538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.091661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:57.102603 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7abf19b8-73f6-43b6-ae8a-574ebe72d31b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.104118 Aug 31 09:46:57.103185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 31/60] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:56 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:57.583033 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:57.583877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:57.591418 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.592018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.592563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.593584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.594225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.594766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.660339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:57.660873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:57.669882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.670792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.671336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.672185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.672899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.673418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.731108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:57.737798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:57.740024 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1bd454ce-8681-4724-9c8d-0f6afbceb876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.161584 Aug 31 09:46:57.740609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 30/61] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:57 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:57.745447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-db0b02f7-fadd-476c-ba5e-cc1e0d8b5bf4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.089510 Aug 31 09:46:57.746068 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 32/62] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:57 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:57.776635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:57.777286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:57.783690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.784175 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.784608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.785351 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.785807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.786230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.846739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:57.854691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:57.856132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:57.857261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4902a01a-80e9-4b36-9848-2d14e6501fd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.084451 Aug 31 09:46:57.857832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 31/63] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:57 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:57.936858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:57.937504 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:57.943540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.944025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.944735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:57.945460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:57.945912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:57.946332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.008914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.017222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-41933a09-0363-49af-8c69-93f6f434ac50 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.084135 Aug 31 09:46:58.018400 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:57 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:46:58.127694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:58.128302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:58.134215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.134692 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.135117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.135793 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.136234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.136648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.200036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.208059 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d26e421e-8538-4d9d-8bdf-4473fc6225e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1241 microversion: 2.1 time: 0.084329 Aug 31 09:46:58.208624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:58 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:58.760165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:58.760837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:58.765556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:58.766180 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:58.766811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.767302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.767736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.768426 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.768881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.769335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.772141 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.772618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.773072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.773752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.774198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.774615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.784025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:58.835074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.842572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dfaff2ea-4cd0-4691-bde3-c6d1ffcdb169 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1245 microversion: 2.1 time: 0.080739 Aug 31 09:46:58.843144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 33/66] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:58 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:58.880844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:58.885961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:58.901361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.910263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.910485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9cbd4c35-1be0-4600-8e1b-ca6a6cd5847e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.154153 Aug 31 09:46:58.910749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.911075 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 34/67] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:58 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:58.911231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.911860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:58.912486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:58.912904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:58.978796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.988295 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.989809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:58.990912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-549f5c65-04ea-4bec-bdbf-b2d3bb0e5c3f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.114268 Aug 31 09:46:58.991655 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:46:58 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:46:59.041160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:59.041944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:59.052745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.054256 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.055070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.055945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.056547 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.057082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.158416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:59.170576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-91411205-0840-4c85-ac23-28e8fd2604c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1225 microversion: 2.1 time: 0.135222 Aug 31 09:46:59.171754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 35/69] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:59 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:59.229048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:59.229696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:59.236453 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.236936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.237387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.238077 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.238520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.239008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.301342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:46:59.309380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-edf71e9c-c433-4172-93e2-4a8b42bb6d26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1233 microversion: 2.1 time: 0.084140 Aug 31 09:46:59.309952 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:59 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:46:59.883133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:59.893077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:59.908667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.910856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.911436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.912363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.921652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.926628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.934101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:59.935198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:46:59.937297 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:59.946519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.947289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.948129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:59.949403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:59.950961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:59.951810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.076098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.090064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-59f58402-43af-4d85-908d-5c4d30b7a323 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1237 microversion: 2.1 time: 0.230298 Aug 31 09:47:00.091335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 36/71] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:59 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1237 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:00.097624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:00.098682 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:00.107483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:00.108276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:00.108917 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.110415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:00.111060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:00.111673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.211328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.226038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6468144c-e856-437d-892c-d6027581db5c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.297287 Aug 31 09:47:00.239747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:46:59 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:00.239747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:00.239747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:00.240174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=24 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:00.262708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:00.263218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:00.263651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.264383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:00.264841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:00.304642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.434492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.445130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.449151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.471595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.479080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0674f852-4006-48d9-902b-c67e42c00a4d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1334 microversion: 2.20 time: 0.380329 Aug 31 09:47:00.480106 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 37/73] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:00 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1334 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:00.491385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ac94d65a-384a-4e94-837e-045281acdd49 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1273 microversion: 2.1 time: 0.262500 Aug 31 09:47:00.495758 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 37/74] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:00 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:00.510315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:00.511224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:00.518245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:00.518861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:00.519536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.521157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:00.521833 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:00.522776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:00.618528 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:00.628668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-979b957f-bd4d-41b6-ab68-48032aef80db tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1289 microversion: 2.1 time: 0.137161 Aug 31 09:47:00.629275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 38/75] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:00 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:01.113686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:01.114307 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:01.120568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.121096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.121723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.122432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.122893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.123319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.209660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.217286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3ba7ee16-3672-4971-832a-9aba37133e73 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1293 microversion: 2.1 time: 0.108260 Aug 31 09:47:01.217867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:01 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:01.248080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:01.248879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:01.251540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.253321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=24 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.260847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.261495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.262145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.262921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.263469 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.263960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.463142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.474773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-de89dd9e-8756-46e0-b14e-273b4904c8b2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.230755 Aug 31 09:47:01.475967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:01 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:01.505021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:01.505995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:01.517659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.518341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.518953 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.522774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.523705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.524520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.542797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:01.546481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:01.565685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.567416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.571622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.574361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.575610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.577715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.642957 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.673307 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.675432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.676877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c56dc299-74b9-4f07-bd44-7e10555ae366 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1340 microversion: 2.20 time: 0.178097 Aug 31 09:47:01.677639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 39/78] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:01 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1340 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:01.684038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:01.697606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:01.738979 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.739766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.740359 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.741557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.742241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:01.742803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:01.752537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.807784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.818208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-48036506-67a7-4fc5-956a-a929150a8dc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1273 microversion: 2.1 time: 0.292132 Aug 31 09:47:01.818840 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:01 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:01.874295 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:01.892993 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0aea4668-74fa-4f1e-a468-b8fbf4d5dcca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1307 microversion: 2.1 time: 0.214025 Aug 31 09:47:01.899377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:01 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:01.976517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-c53b42fb-2b61-4a0d-8ce1-a8b607621c81 req-ff665960-9444-481d-84eb-921ce77c73cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3bc169-af8c-43fa-9d36-1dd91bfc54aa", "tag": "b6e0ce8f-d9eb-4848-9b30-ae132fa4ce35"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:01.998914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c53b42fb-2b61-4a0d-8ce1-a8b607621c81 req-ff665960-9444-481d-84eb-921ce77c73cf service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:01.999407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c53b42fb-2b61-4a0d-8ce1-a8b607621c81 req-ff665960-9444-481d-84eb-921ce77c73cf service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.001738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c53b42fb-2b61-4a0d-8ce1-a8b607621c81 req-ff665960-9444-481d-84eb-921ce77c73cf service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.026574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-c53b42fb-2b61-4a0d-8ce1-a8b607621c81 req-ff665960-9444-481d-84eb-921ce77c73cf service nova] Creating event network-changed:b6e0ce8f-d9eb-4848-9b30-ae132fa4ce35 for instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa on hv-cinder-83754 Aug 31 09:47:02.034877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-c53b42fb-2b61-4a0d-8ce1-a8b607621c81 req-ff665960-9444-481d-84eb-921ce77c73cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064511 Aug 31 09:47:02.036670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 41/81] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:02.125842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc5c963-21d3-40d1-9e50-7ea8bd737dc1", "name": "network-vif-plugged", "status": "completed", "tag": "f6b2dd7f-fff8-4a07-910d-50ac5cbd3de0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:02.143743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.144534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.145530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.183701 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Creating event network-vif-plugged:f6b2dd7f-fff8-4a07-910d-50ac5cbd3de0 for instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 on hv-cinder-83754 Aug 31 09:47:02.184222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 09:47:02.185040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-b6f81cbb-70d4-4744-81f3-a0e7d15a14f0 req-f9f8f70c-a8a2-48ae-8bc1-38e55f725bd4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 09:47:02.189757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.190417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.190857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.191578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.192027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.192646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.202573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.compute.rpcapi [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 09:47:02.204156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] Releasing lock "compute-rpcapi-router" {{(pid=132478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 09:47:02.226461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c0060ae5-84bf-415a-ae57-ab34c6e25189 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212558 Aug 31 09:47:02.228812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 41/82] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:02.243432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:02.244471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:02.274033 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.278395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.279062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.281523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.283533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.285676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.499212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:02.500065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:02.508143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.508390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.509161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.510085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.510740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.511420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.530564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:02.571963 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c851cd55-05b6-4f42-8ef6-6ab325f66622 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1293 microversion: 2.1 time: 0.334396 Aug 31 09:47:02.587371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:02 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1293 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:02.702393 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:02.703317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:02.710323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.710908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.711430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.712410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.713117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.713927 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.814747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:02.824177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:02.828167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:02.829815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:02.831719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-aba26f52-c05d-4bfd-bafb-bb3d26ac2fbf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1340 microversion: 2.20 time: 0.132834 Aug 31 09:47:02.832026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f1cc5ba2-74ef-4c9c-ba01-d96f0180e8de tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.340243 Aug 31 09:47:02.832163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 43/84] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:02 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1340 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:02.833166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:02 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:02.851592 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:02.852288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:02.858345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.858908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.860039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.860813 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.861401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.861907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.924113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:02.924716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:02.930674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.931159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.931595 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.932388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:02.932843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:02.933295 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:02.943434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:02.951647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fc7d6690-ab77-4163-b9e2-056d977c8f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1279 microversion: 2.1 time: 0.103786 Aug 31 09:47:02.952550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 44/86] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:02 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:03.010949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:03.018520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a20a8acb-0c4d-4d19-91cc-cadedd0f34cc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1295 microversion: 2.1 time: 0.098883 Aug 31 09:47:03.019097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 43/87] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:02 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:03.603733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:03.604367 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:03.610708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:03.611204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:03.611701 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:03.612448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:03.612909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:03.613372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:03.676299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:03.685056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b5ad3db6-6240-458b-aa86-4d8380351818 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1301 microversion: 2.1 time: 0.085013 Aug 31 09:47:03.685640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 45/88] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:03 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:03.852907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:03.853458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:03.854015 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:03.854628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:03.859404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:03.859887 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:03.860318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:03.860546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:03.861026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:03.861152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:03.861485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:03.861591 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:03.861902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:03.862270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:03.862734 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:03.863160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:03.996096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:03.999768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:04.004208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:04.005670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:04.006769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-729f437e-4ad2-4b46-9a8c-88b312f1480f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.156574 Aug 31 09:47:04.007325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 46/89] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:03 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:04.007558 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-20477b3e-1c90-4401-a1c7-112c495e5421 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.158407 Aug 31 09:47:04.007890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 44/90] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:03 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:04.011622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:04.012214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:04.018566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:04.019046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:04.019474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:04.020144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:04.020757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:04.021201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:04.039879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:04.040507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:04.046597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:04.047118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:04.047549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:04.048239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:04.048722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:04.049177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:04.112601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:04.120367 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d0dbb726-1d81-47aa-80f0-23a0b89a65f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1295 microversion: 2.1 time: 0.084269 Aug 31 09:47:04.120944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:04 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:04.151632 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:04.159808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6fcc14aa-1e07-47d8-a4c2-226b0f3b7c73 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.151547 Aug 31 09:47:04.160370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 47/92] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:04 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:04.712035 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:04.712035 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:04.714389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:04.714873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:04.715331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:04.716017 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:04.716465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:04.716886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:04.776863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:04.785183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9d5e46ec-4ef2-4f62-95f6-6f28ba7e9e48 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1301 microversion: 2.1 time: 0.081895 Aug 31 09:47:04.785752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 46/93] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:04 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:05.027801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:05.028416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:05.029612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:05.030228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:05.034493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.034984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.035420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.035984 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.036114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.036469 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.036568 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.036912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.037060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.037631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.038105 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.038510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.170285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.178707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.179016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.180191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.181358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a953a3d9-a4c3-44f2-abb0-59370d0278da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.155576 Aug 31 09:47:05.181936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 47/94] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:05 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:05.186309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:05.186845 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f1d21db3-3fea-4269-8052-57128c060c42 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.162742 Aug 31 09:47:05.186966 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:05.188270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 48/95] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:05 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:05.192488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:05.193243 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:05.199488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.200039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.200539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.201310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.201825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.202312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.206471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.206965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.207392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.208087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.208539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.208980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.270082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.277795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a94584ce-701f-43c0-ac2f-257fe4d41d1c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1295 microversion: 2.1 time: 0.094900 Aug 31 09:47:05.278396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 48/96] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:05 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:05.329941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.337434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-883b6ff3-4380-4208-8152-ae740d058983 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.148318 Aug 31 09:47:05.337993 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:05 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:05.805592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:05.806129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:05.812013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.812499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.812935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.813642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:05.814096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:05.814515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:05.874505 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:05.882046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-556a027c-b63a-47b8-9e5c-b9983e13f25a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1301 microversion: 2.1 time: 0.080374 Aug 31 09:47:05.882617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:05 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:06.204255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:06.204864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:06.207868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:06.208478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:06.210962 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.211446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.211878 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.212605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.213078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.213517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.214281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.214765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.215195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.215882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.216333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.216753 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.341533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.342723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.350331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.351014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b13a9608-2dae-4159-a370-ccc3181f376c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.147016 Aug 31 09:47:06.351583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 50/99] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:06 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:06.351802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.352888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-37e0b7ba-cf43-41db-b8bb-3365067585cf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.153155 Aug 31 09:47:06.353819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 50/100] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:06 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:06.357535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:06.358092 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:06.358632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:06.358751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:06.365216 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.365366 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.365704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.366138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.366237 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.366770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.366865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.367257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.367677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.367774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.368177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.368612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.450338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.458664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fd86b10b-0040-483c-8549-40ced448f3b8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1295 microversion: 2.1 time: 0.105445 Aug 31 09:47:06.459250 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:06 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:06.513617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.516504 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:06.523904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4fd13217-50ef-4af2-856a-f586c307a48c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.168869 Aug 31 09:47:06.524454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:06 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:06.901765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:06.902326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:06.908756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.909334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.909761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.910433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:06.910877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:06.911288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:06.972674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:06.980840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bb2fe9b5-3745-46aa-82c9-0a09c2face09 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1301 microversion: 2.1 time: 0.082976 Aug 31 09:47:06.981466 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 52/103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:06 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:07.371527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:07.372137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:07.375023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:07.375611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:07.380551 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.381432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.381545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.381906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.382011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.382330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.382626 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.383004 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.383096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.383446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.383539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.383859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.881548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:07.893267 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f473efce-54a7-4871-97df-151729d79713 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.525445 Aug 31 09:47:07.903483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:07 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:07.903483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:07.903483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:07.907944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.908621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.909144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.909879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.910482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.910826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.918878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:07.927910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:07.930385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:07.931530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-04802644-6380-4dad-a263-4d538e28eae7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.560456 Aug 31 09:47:07.932096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 53/105] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:07 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:07.936886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:07.938225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:07.944099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.944847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.945489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:07.946443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:07.947084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:07.947588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.132373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:08.140981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3d07089e-55f6-4f46-9cec-9e752d0d65fa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.207079 Aug 31 09:47:08.142109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 54/106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:07 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:08.146208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:08.147591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:08.148256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:08.154775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6b18d6b2-3afd-4d7b-aa53-c63b04c8e6e9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1295 microversion: 2.1 time: 0.259642 Aug 31 09:47:08.155552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 53/107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:07 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:08.169878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.170389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.170823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.171621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.172019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.172434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.254627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:08.263313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a3e6b505-c8db-447f-872d-323deea9bbaf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1299 microversion: 2.1 time: 0.120002 Aug 31 09:47:08.263880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:08 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:08.916471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:08.917314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:08.927645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.928390 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.928889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.929785 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.930248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.930782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.960110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:08.960738 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:08.969756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.970501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.971012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.971729 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.972235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.972697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.235065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.249443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.251090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.252557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7f71b499-9638-4f66-97a1-784119854ee2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.298499 Aug 31 09:47:09.253369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 56/109] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:08 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:09.266234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:09.267198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:09.273394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:09.274121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:09.274552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.275591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:09.276261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:09.276690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.282023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:09.435970 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.446154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.459610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ff5a54e4-aea6-4dee-a277-def8e79a2830 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.548392 Aug 31 09:47:09.461112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a104dbdb-f02f-4876-89fa-8e2ab5b93baa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.206482 Aug 31 09:47:09.480897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 57/110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:09 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:09.481151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:08 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:09.481424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:09.482222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:09.483803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:09.485299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:09.490096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:09.490608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:09.491027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.491895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:09.492449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:09.492978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.497568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:09.500447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:09.501219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.502022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:09.502561 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:09.503005 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:09.667926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.678087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-214f8070-b77d-490e-92ea-fc4bf8e67349 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.206736 Aug 31 09:47:09.679076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 58/112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:09 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:09.682775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:09.745983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b7938558-b84d-4dc6-8a41-615ab99510be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1299 microversion: 2.1 time: 0.268644 Aug 31 09:47:09.756145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:09 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1299 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:10.204455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-5d3e7591-31dc-48ea-80f9-60d04dc8296f req-f2618ba9-2c87-429b-8e37-9206737f9a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:10.217244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-5d3e7591-31dc-48ea-80f9-60d04dc8296f req-f2618ba9-2c87-429b-8e37-9206737f9a3b service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.218409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-5d3e7591-31dc-48ea-80f9-60d04dc8296f req-f2618ba9-2c87-429b-8e37-9206737f9a3b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.219148 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-5d3e7591-31dc-48ea-80f9-60d04dc8296f req-f2618ba9-2c87-429b-8e37-9206737f9a3b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.264210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-5d3e7591-31dc-48ea-80f9-60d04dc8296f req-f2618ba9-2c87-429b-8e37-9206737f9a3b service nova] Creating event network-changed:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:47:10.278144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:10.278790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:10.291666 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.293374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-5d3e7591-31dc-48ea-80f9-60d04dc8296f req-f2618ba9-2c87-429b-8e37-9206737f9a3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227607 Aug 31 09:47:10.294047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.294668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.297389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.298977 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 59/114] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:10.299446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.299936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.487207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:10.488140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:10.510580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.511336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.511782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.513808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.514342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.514777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.631258 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:10.641971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:10.643621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:10.645212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-bf7a06a9-4ffe-4fca-bd16-8df183ce3e5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.373190 Aug 31 09:47:10.646277 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 56/115] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:10 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:10.652438 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:10.654193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:10.665542 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.666244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.667901 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.669776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.670249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.670733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.678111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:10.686484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-912a5ef3-72aa-42e1-b999-2fe5cd67f406 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.205194 Aug 31 09:47:10.687095 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:10 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:10.699761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:10.700695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:10.708308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.709145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.709955 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.710814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.711288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.711716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.848251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:10.856180 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bf909231-c103-4c64-9d25-8ec2f721bb8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.160127 Aug 31 09:47:10.856775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 61/117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:10 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:10.863077 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:10.871468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:10.879594 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.880835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.881583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:10.882688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:10.883349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:10.883967 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:11.014064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:11.022135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-080d14b5-c170-42b3-9d33-e471a2e7917b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.374146 Aug 31 09:47:11.022724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 57/118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:10 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:11.044862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:11.055999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e421622d-9f5f-45a8-835c-25de83a56cb9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.197810 Aug 31 09:47:11.056583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 62/119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:10 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:11.667669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:11.668369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:11.675423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:11.675914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:11.676353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:11.677194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:11.677657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:11.678091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:11.708102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:11.708817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:11.714774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:11.715257 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:11.715679 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:11.716627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:11.717305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:11.717925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:11.828360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:11.836989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:11.838668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:11.839960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-00444c77-db74-4013-a32a-8d69faecb0bd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.176136 Aug 31 09:47:11.840527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 58/120] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:11 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:11.863276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:11.870743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f830d742-f99a-4d4e-beb9-0062671c917a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.166430 Aug 31 09:47:11.871293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 63/121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:11 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:11.879127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:11.879851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:11.881753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:11.887710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:11.888312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:11.889007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:11.889738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:11.890212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:11.891181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.019650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:12.027309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-99916f00-b45c-4053-bc8a-74b10ec86838 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.152591 Aug 31 09:47:12.027930 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:11 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:12.042994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:12.043536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:12.050126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.050610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.051043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.051726 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.052181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.052603 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.077177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:12.078405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:12.084403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.085141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.085578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.086269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.086827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.087412 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.186001 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:12.193661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b66136c5-7695-4840-b44b-e9fbdb2f0f3d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.154548 Aug 31 09:47:12.194490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:12 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:12.381013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:12.385513 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9370735-2f4f-4598-97c7-d2cf483e6938", "tag": "e6de08fc-180c-40b1-a1da-58f497731eef"}, {"name": "network-changed", "server_uuid": "1e0d2303-37de-40e0-b537-804a86067dee", "tag": "f09361e0-942b-40ba-a8e3-5c45f1f23504"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:12.387525 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:12.397908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.398491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.398917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.399377 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b3f71488-cbc3-4daa-a729-fe5f4cedb49c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.326173 Aug 31 09:47:12.399960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 60/124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:12 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:12.411995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] Creating event network-changed:e6de08fc-180c-40b1-a1da-58f497731eef for instance a9370735-2f4f-4598-97c7-d2cf483e6938 on hv-cinder-83754 Aug 31 09:47:12.412492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] Creating event network-changed:f09361e0-942b-40ba-a8e3-5c45f1f23504 for instance 1e0d2303-37de-40e0-b537-804a86067dee on hv-cinder-83754 Aug 31 09:47:12.418591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-e16d3341-a473-4904-a37b-039784f42d46 req-9bef48c9-efcd-4f64-94d5-f5781de3398b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038367 Aug 31 09:47:12.419170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 65/125] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:12.862424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:12.863029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:12.869124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.869630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.870064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.870743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.871243 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.871638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.892592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:12.893541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:12.899653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.900134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.900556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:12.901270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:12.901722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:12.902138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.004547 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.013937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.016129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.017296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c34b7740-41e3-4d27-8a90-0c67af527700 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.158740 Aug 31 09:47:13.017855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 61/126] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:12 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:13.036475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.044059 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a2b61f66-3cc4-4c99-8525-10e7849b337e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.156259 Aug 31 09:47:13.044622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 66/127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:12 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:13.047513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:13.048118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:13.054490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:13.055254 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:13.055688 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.056391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:13.056841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:13.057288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.191283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.199104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-274ce242-687e-48ed-a86b-82a2470b7730 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.155393 Aug 31 09:47:13.199782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 62/128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:13 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:13.215481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:13.216088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:13.222582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:13.223068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:13.223503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.224193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:13.224645 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:13.225109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.353529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.361587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0d80c7ac-1768-4a60-aa67-bc02e32cb350 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.150028 Aug 31 09:47:13.362155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 67/129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:13 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:13.419420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:13.420028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:13.426600 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:13.427071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:13.427495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.428196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:13.428642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:13.429083 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:13.553299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:13.560788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-29b237cb-4db5-499c-adf4-1699adb52431 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.145224 Aug 31 09:47:13.561379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 63/130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:13 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:14.039966 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:14.040580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:14.047383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.047805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.048215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.048900 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.049384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.049807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.064248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:14.065579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:14.077392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.079570 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.080021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.080744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.081250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.081684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.192741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.200937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.202392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.204061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cb451b67-84f0-47d7-9def-a45856a5a764 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.168023 Aug 31 09:47:14.204620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 68/131] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:14 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:14.214923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.219921 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:14.220519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:14.223003 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b7e69da9-037d-4653-8a1c-6e784ee75cd5 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.163346 Aug 31 09:47:14.223566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 64/132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:14 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:14.226377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.226869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.227301 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.228023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.228470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.228890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.357460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.365210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3752eecc-6911-49d0-8401-c85d7952af84 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.149476 Aug 31 09:47:14.365786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:14 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:14.383045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:14.383647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:14.389734 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.390757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.391185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.391861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.392309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.392726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.528308 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.536229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3ff39c93-6741-4f23-a8d8-40d0ebdc61cf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.156935 Aug 31 09:47:14.536980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:14 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:14.581745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:14.582265 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:14.588132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.588610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.589072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.589749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:14.590198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:14.590624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:14.724053 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:14.731815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-31ed6350-de4b-4891-b107-e1a0a86e0516 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.154031 Aug 31 09:47:14.732456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 70/135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:14 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:15.227153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:15.227745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:15.233824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.234315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.234759 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.235444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.235900 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.236324 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.245507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:15.246152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:15.252061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.252558 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.253019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.253741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.254592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.254592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.368523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.377193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.379076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.380492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b4434bff-fd32-4b74-baca-b6176088dde1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.157175 Aug 31 09:47:15.381383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 66/136] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:15 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:15.386975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:15.387589 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:15.395236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.395741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.396189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.396936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.397370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.398011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.399612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.407756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1b1c8c11-ceea-4484-a4a1-fff425607647 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.166199 Aug 31 09:47:15.408414 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:15 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:15.531710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.539281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-10c5177e-f0eb-488c-8d72-11aa6849c18c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.156926 Aug 31 09:47:15.539842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 67/138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:15 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:15.557074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:15.557682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:15.564105 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.564592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.565060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.565749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.566232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.566654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.693639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.701480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5f207b8b-09af-40ea-be5d-aaadf9d3c668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.148276 Aug 31 09:47:15.702049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 72/139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:15 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:15.752552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:15.753196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:15.759032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.759511 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.759935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.760611 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:15.761088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:15.761507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:15.776077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:15.896932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:15.907255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5dbd86f9-af71-4bf3-92ef-849a6545ba02 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.158331 Aug 31 09:47:15.907857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 68/140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:15 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:16.403610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:16.404214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:16.407864 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:16.411586 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.412064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.412492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.413210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.413664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.414080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.429411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:16.430021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:16.436146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.436629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.437227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.437938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.438386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.438833 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.550237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:16.558141 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:16.559569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:16.560668 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-82d5db3e-7a8e-4ff1-88f3-4aa91e500916 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.160944 Aug 31 09:47:16.561254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 73/141] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:16 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:16.565585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:16.566174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:16.572060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.572339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:16.572541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.572986 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.573673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.574126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.574707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.580727 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ab949635-6118-4468-92e3-444d6a5d801e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.155090 Aug 31 09:47:16.581329 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 69/142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:16 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:16.700387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:16.708376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-efbba940-7a84-4a3c-881b-8440e18447e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.146198 Aug 31 09:47:16.708936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 74/143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:16 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:16.722186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:16.722788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:16.728646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.729168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.729605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.730285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.730736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.731155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.867262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:16.875066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c27c3852-bf7d-4bb8-bb42-801274cd66bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.157259 Aug 31 09:47:16.875627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 70/144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:16 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:16.927653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:16.928256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:16.934121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.934597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.935022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.935697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:16.936196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:16.936563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:16.941036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:17.065081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:17.072815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b3b6b1f9-8dd1-446a-a25f-a3964e10fe82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.149008 Aug 31 09:47:17.073622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 75/145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:16 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:17.585025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:17.585667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:17.591602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.592097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.592538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.593787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.594248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.597646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.602174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:17.602995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:17.608951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.609463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.609891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.610580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.611016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.611431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.732296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:17.739163 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:17.741224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:17.742677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:17.743776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ee4c3e57-5f59-457d-8d45-e74eb550ca3a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.162634 Aug 31 09:47:17.744451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 71/146] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:17 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:17.746627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ae13c083-3bc8-4de5-b2f6-ef36d7375970 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.148345 Aug 31 09:47:17.747358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 76/147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:17 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:17.749017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:17.749618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:17.755481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.755967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.756401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.757126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.757559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.757983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.895935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:17.896081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:17.896642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:17.902483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.902971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.903405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:17.903885 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c97a0cdc-f2a4-407d-8a94-93f6f4776fa4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.158291 Aug 31 09:47:17.904122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:17.904459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 72/148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:17 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:17.904600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:17.905071 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.040101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:18.048295 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-969e9e30-d384-42ec-90c1-436043d4bb7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.156178 Aug 31 09:47:18.048860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 77/149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:17 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:18.094241 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:18.094804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:18.101478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.102004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.102441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.103142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.103596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.104023 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.235789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:18.243408 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c23c19bf-04a9-4f03-9d03-b153e64324be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.153301 Aug 31 09:47:18.243973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 73/150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:18 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:18.765279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:18.765887 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:18.766351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:18.766955 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:18.771885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.772371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.772741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.772838 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.773257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.773508 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.773684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.773959 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.774355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.774446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.774801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.775213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.919614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:18.921299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:18.928872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:18.929412 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3dbbabf0-1b7d-42b3-b6e8-463ec58a1876 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.166728 Aug 31 09:47:18.929981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 74/151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:18 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:18.934747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:18.935704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:18.941832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:18.943082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9f71bd46-8fa6-43f3-a09f-1839f5ece13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.181789 Aug 31 09:47:18.943591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 78/152] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:18 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:18.945709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.946366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.946953 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:18.947822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:18.948656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:18.949113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.068612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:19.069523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:19.075473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.075961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.076791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.077686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.078148 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.078574 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.079164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:19.087097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b5806e6d-9a0e-4f47-bd15-4080fcd5c9ae tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.155968 Aug 31 09:47:19.087866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 75/153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:18 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:19.210004 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:19.217742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6542f607-721a-43d7-86ba-5e34fdc58d48 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.152963 Aug 31 09:47:19.218866 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 79/154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:19 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:19.263572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:19.264184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:19.270285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.270774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.271214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.271904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.272363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.272807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.406453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:19.414171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-27ce189f-411e-42af-b4af-5327b9e909ff tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.154458 Aug 31 09:47:19.414746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 76/155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:19 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:19.953378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:19.954014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:19.959829 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.960313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.960746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.961459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.961915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.962337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.967472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:19.968157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:19.974386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.974882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.975290 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:19.975974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:19.976431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:19.977353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.105816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.113538 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dafe5ae6-6c2e-40fe-9e8e-15b0c406971a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1314 microversion: 2.1 time: 0.164540 Aug 31 09:47:20.114114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 80/156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:19 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:20.131304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:20.131917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:20.137654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:20.138149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:20.138581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.139324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:20.139915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:20.140873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.149138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.159115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.160774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.162041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c9022f9b-a5a1-4ff8-a748-6cfc7cad4eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.198434 Aug 31 09:47:20.162748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 77/157] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:19 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:20.240162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:20.240773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:20.248569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:20.249805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:20.250350 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.251163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:20.251458 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:20.252233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.290637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.299542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2ad1cfd9-5229-4264-8ee0-efee395bc48c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.171824 Aug 31 09:47:20.300125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 81/158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:20 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:20.393360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.402465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2e187903-dfda-47b8-8448-998ee878fa41 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.166083 Aug 31 09:47:20.403807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 78/159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:20 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:20.434351 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:20.434987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:20.441479 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:20.441966 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:20.442396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.443080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:20.443527 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:20.443930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:20.576237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:20.583979 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cbff6688-31bc-45a1-8cac-971d671adc0e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.153551 Aug 31 09:47:20.584737 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 82/160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:20 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:21.138221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:21.138908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:21.157081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.157598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.158039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.158758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.159248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.159680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.186941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:21.188699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:21.204949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.206278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.206969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.207724 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.208597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.209067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.392488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.403860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.405371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.408293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cfbc077e-3242-4999-a1b3-6651059134a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.225347 Aug 31 09:47:21.408860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 83/161] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:21 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:21.426767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:21.427686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:21.433670 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.434360 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.434980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.435685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.436139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.436785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.475275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.482982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c68d4c2d-69ac-40ad-b9da-1d7afd49d4d2 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1501 microversion: 2.1 time: 0.350876 Aug 31 09:47:21.493427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 79/162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:21 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:21.499234 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:21.499996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:21.517018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.517516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.517964 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.518621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.519071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.519489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.582816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.591667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4094d773-b0fd-4014-8717-fa48808a7772 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.168775 Aug 31 09:47:21.592256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 84/163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:21 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:21.612278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:21.613424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:21.619723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.620376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.621001 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.621993 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:21.622601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:21.623459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:21.774415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.791756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5fff0fa5-f53e-4bb2-ab30-8b95eaf0232a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.296681 Aug 31 09:47:21.793211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 80/164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:21 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:21.866990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:21.876685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8059d12c-6562-4d0e-863e-7f8cc9e698eb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.268648 Aug 31 09:47:21.880128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 85/165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:21 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:22.038239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-43808f74-d650-46de-b0e0-5403f69602e5 req-aa3b3bcf-d1e8-4310-9f57-62e6a594f3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d0bc15-4bb1-46c5-82f5-ad82d487a65e", "tag": "f2d9c453-c42a-42fe-9b7a-22639ee0f7fe"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:22.047545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-43808f74-d650-46de-b0e0-5403f69602e5 req-aa3b3bcf-d1e8-4310-9f57-62e6a594f3d3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.048114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-43808f74-d650-46de-b0e0-5403f69602e5 req-aa3b3bcf-d1e8-4310-9f57-62e6a594f3d3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.048608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-43808f74-d650-46de-b0e0-5403f69602e5 req-aa3b3bcf-d1e8-4310-9f57-62e6a594f3d3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.060768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-43808f74-d650-46de-b0e0-5403f69602e5 req-aa3b3bcf-d1e8-4310-9f57-62e6a594f3d3 service nova] Creating event network-changed:f2d9c453-c42a-42fe-9b7a-22639ee0f7fe for instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e on hv-cinder-83754 Aug 31 09:47:22.066915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-43808f74-d650-46de-b0e0-5403f69602e5 req-aa3b3bcf-d1e8-4310-9f57-62e6a594f3d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032343 Aug 31 09:47:22.067669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 81/166] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:22.432770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:22.433411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:22.439688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.440162 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.440592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.441294 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.441780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.442193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.588251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:22.601579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:22.603141 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:22.604270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9fe365fc-35b3-48b9-a215-8904595002a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.175413 Aug 31 09:47:22.604834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 86/167] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:22 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:22.620168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:22.620717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:22.627524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.628158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.628586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.629456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.630054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.630639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.813858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:22.814460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:22.818249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:22.820798 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.821544 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.821941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.822624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.823229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.823651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.830890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-784cca46-9909-4434-bcd6-1e71f35700a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.218402 Aug 31 09:47:22.832240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 82/168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:22 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:22.903765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:22.904771 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:22.911278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.911947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.912373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.913332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:22.913941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:22.914368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:22.971181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:22.979343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-48744606-0ff0-4c22-9b98-a08a614ccfb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.169937 Aug 31 09:47:22.979930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 87/169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:22 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:23.050169 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:23.057925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-35e90d40-dfc1-4fc7-89e1-71868d2f59e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.159522 Aug 31 09:47:23.058487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 83/170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:22 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:23.628881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:23.629522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:23.635239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:23.635715 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:23.636139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:23.636810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:23.637278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:23.637689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:23.768904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:23.778410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:23.781183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:23.782287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3d41a848-cd30-481f-9972-72168165694d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.157972 Aug 31 09:47:23.782842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 88/171] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:23 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:23.854909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:23.855532 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:23.862033 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:23.862516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:23.862954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:23.863653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:23.864151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:23.864582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.002091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:24.003761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:24.005960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:24.010080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:24.010555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:24.011744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.012734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:24.013309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:24.013774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.016243 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-19a288b9-6960-4a5a-903b-7c11b1f05b2c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.165012 Aug 31 09:47:24.030823 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 84/172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:23 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:24.082706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:24.084416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:24.094272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:24.094835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:24.095354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.096115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:24.096661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:24.097155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.161694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:24.169600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e9ee330d-7901-4e81-acef-61e5489cddfd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.171680 Aug 31 09:47:24.170176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 89/173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:23 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:24.239804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:24.242121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:24.248641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-366bae58-dfff-4380-b127-e466958c1248 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.173967 Aug 31 09:47:24.249247 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 85/174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:24 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:24.805489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:24.806133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:24.812163 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:24.812643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:24.813110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.813845 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:24.814249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:24.814672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:24.939579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:24.947693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:24.949144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:24.950228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d769d5f2-0dd0-4a0b-97a5-36abdf1cb85f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.148605 Aug 31 09:47:24.950807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 90/175] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:24 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:25.042592 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:25.043209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:25.049308 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.049796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.050232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.050919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.051372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.051794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.180217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:25.188766 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-bfa444d6-92a9-4009-9851-c2bf184797f0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.150041 Aug 31 09:47:25.189359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 86/176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:25 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:25.190478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:25.191114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:25.197164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.197654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.198068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.198743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.199187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.199607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.269051 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:25.269654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:25.275462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.275950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.276381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.277090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.277544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.277958 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.330307 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:25.334154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:25.339514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e6ec8f22-a2dc-47d8-82d6-8c2459e2ffb0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.153379 Aug 31 09:47:25.340092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 91/177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:25 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:25.423300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:25.430895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-db052915-2f4a-4b09-9c8d-5fa24cbd3974 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.165674 Aug 31 09:47:25.431461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 87/178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:25 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:25.973145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:25.973743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:25.979556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.980032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.980458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:25.981155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:25.981604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:25.982016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.115411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:26.124747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:26.125777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:26.126871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4d026581-b020-4b4d-bb07-882ec5a1ed06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.157673 Aug 31 09:47:26.127420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 92/179] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:25 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:26.209345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:26.209888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:26.215879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:26.216365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:26.216800 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.217524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:26.218465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:26.218891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.345019 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:26.352510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3ca5ffa5-d35a-4a1a-9554-ebdfab54919a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.147076 Aug 31 09:47:26.353100 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 88/180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:26 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:26.363362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:26.363969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:26.369807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:26.370293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:26.370719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.371407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:26.371861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:26.372281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.451373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:26.452498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:26.458584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:26.459071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:26.459557 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.460195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:26.460656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:26.461290 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:26.502224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:26.509757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e4a95aba-0423-4e69-a8eb-400465dc3204 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.150133 Aug 31 09:47:26.510321 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 93/181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:26 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:26.591107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:26.599415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-82b15ad7-941b-46b3-b548-0716474daa0b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.151886 Aug 31 09:47:26.599981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 89/182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:26 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:27.149435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:27.150041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:27.156579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.157090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.157524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.158208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.158661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.159083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.286104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:27.294004 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:27.295451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:27.296549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bce5378d-41bc-42c0-bd37-f70884771a7e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.151035 Aug 31 09:47:27.297142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 94/183] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:27 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:27.373135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:27.373663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:27.380452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.381005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.381451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.382142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.382598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.383140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.518453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:27.526606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-af38dcd5-63a1-4203-97ce-4ddbe12cfa5c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.157340 Aug 31 09:47:27.527359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 90/184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:27 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:27.530774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:27.531419 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:27.537476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.537960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.538398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.539084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.539537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.539963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.633006 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:27.633539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:27.644107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.644609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.645055 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.645739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:27.646183 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:27.651471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:27.729781 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:27.737891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-432c498e-6957-4ac0-a639-be2be444a5f4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.210877 Aug 31 09:47:27.738459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 95/185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:27 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:28.113080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:28.120619 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-abb22463-edce-4061-bc0e-31786a543a98 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.491805 Aug 31 09:47:28.121209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 91/186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:27 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:28.319462 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:28.320039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:28.325949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:28.326428 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:28.326883 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:28.327567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:28.328010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:28.328423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:28.459860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:28.468366 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:28.469906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:28.471103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fea2032c-9f43-40b9-a726-3e3b7c886697 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.155892 Aug 31 09:47:28.471675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 96/187] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:28 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:28.548066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:28.548675 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:28.554634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:28.555110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:28.555540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:28.556215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:28.556668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:28.557121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:28.681782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:28.689255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f85071c0-dd74-4c26-a83a-a6732b4a1354 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.145707 Aug 31 09:47:28.689812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 92/188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:28 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:28.758567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:28.759174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:28.765582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:28.766067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:28.766500 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:28.767268 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:28.767673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:28.768097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:28.897478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:28.906869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-41836d57-198c-41fc-853f-4540d13bb2b4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.151702 Aug 31 09:47:28.907575 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 97/189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:28 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:29.141655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:29.142297 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:29.148281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.148769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.149239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.149935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.150389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.150811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.279526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:29.288610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a8ac5155-4d83-4fef-b42f-bdf787020fdf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.151521 Aug 31 09:47:29.291091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 93/190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:29 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:29.493717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:29.494321 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:29.500195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.500678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.501220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.501905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.502356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.502774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.633904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:29.642504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:29.643940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:29.645049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-09967e85-2af6-4ee2-9d1a-37a25287467a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.155120 Aug 31 09:47:29.645611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 98/191] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:29 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:29.711826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:29.712475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:29.718895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.719380 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.719812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.720496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.720951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.721398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.846904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:29.854832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-476d0f38-1caa-4d18-87db-e7b33c5e5c44 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.147285 Aug 31 09:47:29.855652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 94/192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:29 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:29.928139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:29.928745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:29.934596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.935079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.935511 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:29.936201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:29.936647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:29.937088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.235795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:30.243372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-46cc91fb-f306-4991-bb93-1a4383ee8a5d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.319213 Aug 31 09:47:30.243939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 99/193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:29 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:30.311299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:30.311961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:30.318539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.319289 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.319724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.320437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.320888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.321337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.389214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59e4d04-0cc8-492b-a38e-f14ad1a67b95"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:30.391627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:30.397455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.397948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.398389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.399078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.399530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.399952 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.450472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:30.459880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3a35e989-4c1b-4b11-b33e-9c35ea1ace92 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.152440 Aug 31 09:47:30.460648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 95/194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:30 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:30.667618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:30.668215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:30.674032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.674507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.674932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.675609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.676401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.676803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.812736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:30.821597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:30.823028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:30.824405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-926edefd-15a9-4766-88d7-ac7feffec00e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.160639 Aug 31 09:47:30.825116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 96/195] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:30 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:30.830028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-db9cf2e5-66da-4285-8834-2eed46f1e1e7 req-fae0a909-fcd5-4b50-945e-e96480fbcd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3bc169-af8c-43fa-9d36-1dd91bfc54aa", "name": "network-vif-plugged", "status": "completed", "tag": "b6e0ce8f-d9eb-4848-9b30-ae132fa4ce35"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:30.840886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-db9cf2e5-66da-4285-8834-2eed46f1e1e7 req-fae0a909-fcd5-4b50-945e-e96480fbcd83 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.841853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-db9cf2e5-66da-4285-8834-2eed46f1e1e7 req-fae0a909-fcd5-4b50-945e-e96480fbcd83 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.842287 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-db9cf2e5-66da-4285-8834-2eed46f1e1e7 req-fae0a909-fcd5-4b50-945e-e96480fbcd83 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.853942 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-db9cf2e5-66da-4285-8834-2eed46f1e1e7 req-fae0a909-fcd5-4b50-945e-e96480fbcd83 service nova] Creating event network-vif-plugged:b6e0ce8f-d9eb-4848-9b30-ae132fa4ce35 for instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa on hv-cinder-83754 Aug 31 09:47:30.859407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-db9cf2e5-66da-4285-8834-2eed46f1e1e7 req-fae0a909-fcd5-4b50-945e-e96480fbcd83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033215 Aug 31 09:47:30.860830 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 97/196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:30.876420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:30.877194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:30.883246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.883732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.884159 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:30.884888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:30.885361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:30.885773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.021295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:31.028971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-df54182c-a71f-42a2-b398-2b3494cdfd9e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.157138 Aug 31 09:47:31.029544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 98/197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:30 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:31.264100 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:31.264614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:31.270389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:31.270871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:31.271299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.271968 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:31.272419 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:31.272833 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.401202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:31.409355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9fea10ab-2237-42bb-b8bb-b474a9d5869c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.149415 Aug 31 09:47:31.409926 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 99/198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:31 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:31.482341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:31.482945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:31.489655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:31.490143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:31.490575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.491497 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:31.491710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:31.492128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.628946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:31.636547 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-93f27030-62eb-490f-bb7e-70cc51f7c9f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.158142 Aug 31 09:47:31.637166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 100/199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:31 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:31.847951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:31.848617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:31.854765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:31.855249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:31.855685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.856373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:31.856824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:31.857269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:31.994821 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:32.003444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:32.004888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:32.006011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-69deae71-4eaf-4ec4-951d-6365366b49bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.162483 Aug 31 09:47:32.006590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 101/200] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:31 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:32.048471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:32.049028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:32.054872 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:32.055372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:32.055785 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:32.056464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:32.056914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:32.057361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:32.183107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:32.192649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e7319466-7a6a-4ae0-892e-9a0120145ed9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.147918 Aug 31 09:47:32.193263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 102/201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:32 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:32.430534 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:32.431342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:32.438478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:32.438478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:32.438478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:32.439022 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:32.439487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:32.439914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:32.444431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:32.581820 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:32.589482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c1fe0205-d3a3-42f1-a3b6-7f66baf8839a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.162785 Aug 31 09:47:32.590054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 103/202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:32 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:32.658952 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:32.659829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:32.667354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:32.667976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:32.668500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:32.669358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:32.669888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:32.670514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:32.848126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:32.858764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b8892e5a-abdf-4afb-920f-0ed1cecfd77f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.204394 Aug 31 09:47:32.859585 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 104/203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:32 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:33.031637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:33.032342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:33.046590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.051465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.052183 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.053142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.053786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.054412 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.353437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e2c08527-a795-48d7-9625-d764571beb81 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "POST /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.966817 Aug 31 09:47:33.372597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 100/204] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:47:30 2022] POST /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1/os-volume_attachments => generated 194 bytes in 2988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:33.407224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:33.407927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:33.415214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.416059 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.416900 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.417804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.418434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.419020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.729834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:33.739306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-acba5d3e-b2cd-47d2-a26c-29a3d3e85cd2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.363536 Aug 31 09:47:33.745922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 101/205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:33 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:33.767595 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:33.768672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:33.796678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.799011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.801325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.804092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.805459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.806815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.900029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:33.918681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:33.920113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:33.925865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-de7baf43-0334-4238-b4a9-1ed0e879f0a8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.900035 Aug 31 09:47:33.926577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 105/206] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:33 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:33.946045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:33.946651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:33.952768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.953819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.954251 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:33.954944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:33.955405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:33.955805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:34.136158 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:34.144496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d5224722-b9e9-4a64-b10e-165ed561c04a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.392047 Aug 31 09:47:34.145108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 102/207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:33 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:34.311933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:34.320218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f49afa08-0d32-4fef-a856-cc2af905fa03 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.389361 Aug 31 09:47:34.322369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 106/208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:33 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:34.779538 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:34.780706 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:34.791274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:34.791769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:34.792191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:34.793072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:34.793521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:34.793931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:34.956109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:34.960593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:34.969659 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:34.970243 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:34.971730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:34.972736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:34.973410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:34.974021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.016833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:35.025147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-de09e384-6af7-4930-8e51-58499a93a588 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.249270 Aug 31 09:47:35.034176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 103/209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:34 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:35.164431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:35.165425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:35.171708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.172517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.173046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.173800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.174558 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.175148 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.198816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:35.229677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:35.232103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:35.233999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-863c7675-eef7-4266-b986-00c5bae40e44 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.282401 Aug 31 09:47:35.235343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 107/210] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:34 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:35.342595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:35.343182 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:35.354444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.354922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:35.355343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.356011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.356869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.357556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.358335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.365661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a967c150-cdd9-447f-92a4-7fd95711c570 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.204848 Aug 31 09:47:35.367053 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 104/211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:35 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:35.458939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-2fc2fa0d-b781-42be-acfd-bc09d3ffb39a req-64d1f9ea-5f12-46b7-8722-77a2451e2b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "name": "network-vif-plugged", "status": "completed", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:35.488190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-2fc2fa0d-b781-42be-acfd-bc09d3ffb39a req-64d1f9ea-5f12-46b7-8722-77a2451e2b66 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.489720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-2fc2fa0d-b781-42be-acfd-bc09d3ffb39a req-64d1f9ea-5f12-46b7-8722-77a2451e2b66 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.491331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-2fc2fa0d-b781-42be-acfd-bc09d3ffb39a req-64d1f9ea-5f12-46b7-8722-77a2451e2b66 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.504638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-2fc2fa0d-b781-42be-acfd-bc09d3ffb39a req-64d1f9ea-5f12-46b7-8722-77a2451e2b66 service nova] Creating event network-vif-plugged:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:47:35.510821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-2fc2fa0d-b781-42be-acfd-bc09d3ffb39a req-64d1f9ea-5f12-46b7-8722-77a2451e2b66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071163 Aug 31 09:47:35.512579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 105/212] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:35.528184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:35.547256 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7b3d6d0b-c4b9-4686-b257-b33c0d839425 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.208814 Aug 31 09:47:35.548190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 108/213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:35 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:36.046689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:36.047910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:36.054625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.055344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.055927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.056842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.057473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.058101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.219130 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:36.227608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-63e2395a-cb1e-4b77-b896-4929a52bd1b3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.185562 Aug 31 09:47:36.228366 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 106/214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:36 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:36.263238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:36.264471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:36.266396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:36.273093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.273582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.274014 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.274704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.275150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.275571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.387805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:36.388407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:36.396251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.397050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.397727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.398780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.399534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.400133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.440531 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:36.453413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:36.455416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:36.456844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3cf18423-9f22-404a-baca-5828a192bb88 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.197473 Aug 31 09:47:36.457624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 109/215] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:36 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:36.568470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:36.569971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:36.578418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.578903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.579334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.580027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:36.581475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:36.581922 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:36.607911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:36.617193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:36.629775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-19efae1a-b5d7-4d28-b815-e8723a168944 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.245865 Aug 31 09:47:36.630850 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 107/216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:36 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:36.815914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:36.831500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-44bd623b-4476-4eb9-aba3-11be2327c33b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.265865 Aug 31 09:47:36.832424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 110/217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:36 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:37.249241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:37.249845 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:37.258675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.259157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.262330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.263042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.263505 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.263934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.435471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:37.443997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a97669c1-4630-44c7-8b55-4cd61c96140c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.198118 Aug 31 09:47:37.445831 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 108/218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:37 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:37.485561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:37.486879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:37.495863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.496357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.497033 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.497913 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.498957 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.499544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.648094 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:37.651281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:37.652433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:37.659285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.659990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.660364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:37.660887 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.661776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.661974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:37.662541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.663117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.663421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fced6c8b-d498-48c4-9bb3-71632b237082 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.183729 Aug 31 09:47:37.664376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 111/219] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:37 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:37.823502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:37.833457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f5f91869-a11f-4746-890f-af279ac40641 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.186236 Aug 31 09:47:37.834137 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 109/220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:37 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:37.855209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:37.855986 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:37.863214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.864331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.865133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:37.866140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:37.867241 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:37.868458 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.035421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:38.048694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-850ae58e-27bd-4141-b4e2-876598995687 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.197662 Aug 31 09:47:38.060594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 112/221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:37 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:38.466152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:38.466680 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:38.474052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:38.474801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:38.475291 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.476210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:38.476899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:38.477672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.631445 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:38.639661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5d2182f3-22d3-4278-a689-356b5054f4c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.177644 Aug 31 09:47:38.640258 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 110/222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:38 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:38.691006 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:38.692183 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:38.700338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:38.701069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:38.701579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.702685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:38.703884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:38.704496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.859100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:38.860465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:38.870045 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:38.871064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:38.871879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.873336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:38.874275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:38.875671 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:38.914010 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:38.922549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:38.928430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:38.929989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-39917b24-9463-4e6a-84a4-101f7068bdf7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.244421 Aug 31 09:47:38.930562 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 113/223] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:38 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:47:39.058078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:39.079562 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:39.080427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:39.091847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a5cc9101-d89b-4aef-8434-1cf971f3197f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.238606 Aug 31 09:47:39.097346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:39.097830 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:39.105113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 111/224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:38 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:39.105824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:39.108264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:39.108832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:39.110510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:39.291630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:39.304357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6d35075c-cd0b-4897-974d-85351b9f427e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.236360 Aug 31 09:47:39.305405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 114/225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:39 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:39.661290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:39.661909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:39.668681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:39.669109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:39.669590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:39.670296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:39.670767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:39.671189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:39.840193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:39.840193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eada7e48-a1cb-45a7-b3cc-0dac9ce7ffc6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.158047 Aug 31 09:47:39.840193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 112/226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:39 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:39.952190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:39.952886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:39.959500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:39.959978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:39.960418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:39.961131 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:39.961597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:39.961999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:40.119573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:40.120188 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:40.143352 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:40.144938 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:40.145463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:40.145901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:40.149276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:40.151990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:40.152601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:40.153939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:40.155502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:40.156781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8ba98430-8b06-45b2-860c-464194f523c8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.208521 Aug 31 09:47:40.158497 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 115/227] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:39 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:40.309897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:40.317843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f739e9b1-1cd5-4c2a-ad35-3ebec4f7ef92 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.202766 Aug 31 09:47:40.318437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 113/228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:40 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:40.328987 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:40.329767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:40.335915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:40.336405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:40.336845 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:40.337580 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:40.338037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:40.338461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:40.472880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:40.480932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9eb4b883-f576-4fa4-b692-5a42891ba3c7 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.156335 Aug 31 09:47:40.481692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 116/229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:40 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:40.835072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:40.835679 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:40.843824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:40.844654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:40.845123 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:40.845987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:40.846581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:40.847009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.003917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:41.014889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-31abdcf7-7bf6-47fe-b6b2-71f1cab232e8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.183667 Aug 31 09:47:41.032160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 114/230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:40 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:41.179079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:41.179693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:41.186123 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.186613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.187048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.187777 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.188228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.188818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.339697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:41.340388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:41.348425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.349183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.349809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.350758 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.351276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.351779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.352283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:41.366353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:41.368681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:41.370930 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-14c0b44b-3014-4de5-b4c8-8b0dd98a9528 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.195361 Aug 31 09:47:41.371941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 117/231] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:41 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:41.503109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:41.503867 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:41.517935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.519637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.522069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.524189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.525851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.528217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.786849 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:41.796498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-24598f36-b0d0-46e2-8c56-eb2dfd2bc3f6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.297943 Aug 31 09:47:41.797929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 118/232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:41 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:41.802828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-cadfb50f-fe15-42fa-8c8c-548fb2d1cff4 req-41250c45-fe70-4f13-aab3-04803e891e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0d2303-37de-40e0-b537-804a86067dee", "name": "network-vif-plugged", "status": "completed", "tag": "f09361e0-942b-40ba-a8e3-5c45f1f23504"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:41.814926 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-cadfb50f-fe15-42fa-8c8c-548fb2d1cff4 req-41250c45-fe70-4f13-aab3-04803e891e8a service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:41.823185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-cadfb50f-fe15-42fa-8c8c-548fb2d1cff4 req-41250c45-fe70-4f13-aab3-04803e891e8a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:41.824103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-cadfb50f-fe15-42fa-8c8c-548fb2d1cff4 req-41250c45-fe70-4f13-aab3-04803e891e8a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:41.837954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:41.838866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-cadfb50f-fe15-42fa-8c8c-548fb2d1cff4 req-41250c45-fe70-4f13-aab3-04803e891e8a service nova] Creating event network-vif-plugged:f09361e0-942b-40ba-a8e3-5c45f1f23504 for instance 1e0d2303-37de-40e0-b537-804a86067dee on hv-cinder-83754 Aug 31 09:47:41.845877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-cadfb50f-fe15-42fa-8c8c-548fb2d1cff4 req-41250c45-fe70-4f13-aab3-04803e891e8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046496 Aug 31 09:47:41.846733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 119/233] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:41.854321 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-db3f1222-5e62-4bd7-859b-6ecb670fdb3c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.518364 Aug 31 09:47:41.855506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:41 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:42.046947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:42.048231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:42.058293 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.058293 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.058293 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.058293 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.058650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.059429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.103957 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:42.315575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:42.323451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e70edc2e-dd10-405d-8ec4-3001bd06c5cd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.286825 Aug 31 09:47:42.337980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 120/235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:42 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:42.397015 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:42.397614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:42.404204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.404687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.405373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.406605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.407054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.407638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.571911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:42.583222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:42.584671 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:42.585809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a6f6b791-d20b-4728-82cb-e6f18b53890d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.192587 Aug 31 09:47:42.586996 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 116/236] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:42 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:42.818156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:42.818623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:42.837641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.838468 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.839873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.841002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.842284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.842990 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.877255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:42.880168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:42.897514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.897514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.897775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:42.898377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:42.898834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:42.903853 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:43.114389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:43.122128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a4367ff2-0d12-401e-987d-f0f12916faa7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.249882 Aug 31 09:47:43.122726 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 117/237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:42 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:43.166468 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:43.176087 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f12f3b32-ba95-40ff-9769-83981ea2853d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.361857 Aug 31 09:47:43.176980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:42 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:43.348061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:43.348787 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:43.356276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:43.356821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:43.357382 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:43.357992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:43.358446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:43.366054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:43.543129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:43.554593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dbd601a5-b4f8-489c-9d9b-35bfae4a5f53 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.212550 Aug 31 09:47:43.555798 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 118/239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:43 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:43.611990 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:43.612577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:43.629039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:43.629556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:43.631208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:43.631975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:43.637294 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:43.641490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:43.836390 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:43.845138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:43.846580 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:43.847944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-069c4bab-9ae4-40bf-a7b1-19861dbbedb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.241142 Aug 31 09:47:43.861494 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 122/240] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:43 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:44.145127 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:44.146747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:44.155081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.155792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.156578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.157875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.158336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.158764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.199312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:44.200407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:44.209946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.211384 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.212167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.213396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.214442 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.215120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.329499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:44.339664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-afa698e2-dd2a-423f-b9fc-d088d5356f71 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.199093 Aug 31 09:47:44.340308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 119/241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:44 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:44.448071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:44.457343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-17f63d57-287d-4b26-9d7b-cb0913a2e7db tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.264728 Aug 31 09:47:44.457922 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 123/242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:44 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:44.581889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:44.582503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:44.588475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.589098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.589449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.590182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.590629 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.593184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.783647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:44.791392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3c062c05-38d1-4173-a454-907ee2bcc18a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.213301 Aug 31 09:47:44.804992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 120/243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:44 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:44.872090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:44.872700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:44.879890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.880659 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.881123 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:44.882213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:44.882680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:44.883106 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.037036 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:45.046229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:45.048476 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:45.049633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ea47cb14-7b10-457e-9666-8acdd4d2a74c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.181777 Aug 31 09:47:45.050447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 124/244] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:44 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:45.364631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:45.365877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:45.372644 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:45.373272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:45.373965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.374917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:45.375453 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:45.375888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.481229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:45.481723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:45.488552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:45.489093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:45.489578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.490259 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:45.497645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:45.498340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.559619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:45.569446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d0717562-0ced-467f-adf9-2c19b3ab671d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.212016 Aug 31 09:47:45.570029 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 121/245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:45 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:45.673561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:45.681343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2795292c-e9ee-4bc9-9ec6-97ccac9e4dc9 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.205412 Aug 31 09:47:45.681908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 125/246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:45 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:45.816081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:45.816802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:45.824847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:45.825647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:45.826428 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.827181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:45.828156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:45.828775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:45.963938 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:45.971601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-23363c13-7bfc-4740-a551-e2ca465d542e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.159465 Aug 31 09:47:45.972178 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 122/247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:45 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:46.073354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:46.074042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:46.080640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.081165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.081602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.082288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.082739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.083158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.232161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:46.243508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:46.245871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:46.247235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1e5cfd6c-a7a4-49b6-98c0-a39e0acbd48c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1407 microversion: 2.20 time: 0.177681 Aug 31 09:47:46.247946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 126/248] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:46 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:46.327303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-d5eebae5-0b26-41c5-8e9a-a0ad29d54b16 req-c34ac968-4577-44f8-b9cb-87d0a6426484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9370735-2f4f-4598-97c7-d2cf483e6938", "name": "network-vif-plugged", "status": "completed", "tag": "e6de08fc-180c-40b1-a1da-58f497731eef"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:46.334765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:46.342275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d5eebae5-0b26-41c5-8e9a-a0ad29d54b16 req-c34ac968-4577-44f8-b9cb-87d0a6426484 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.343149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d5eebae5-0b26-41c5-8e9a-a0ad29d54b16 req-c34ac968-4577-44f8-b9cb-87d0a6426484 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.344368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d5eebae5-0b26-41c5-8e9a-a0ad29d54b16 req-c34ac968-4577-44f8-b9cb-87d0a6426484 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.357732 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-d5eebae5-0b26-41c5-8e9a-a0ad29d54b16 req-c34ac968-4577-44f8-b9cb-87d0a6426484 service nova] Creating event network-vif-plugged:e6de08fc-180c-40b1-a1da-58f497731eef for instance a9370735-2f4f-4598-97c7-d2cf483e6938 on hv-cinder-83754 Aug 31 09:47:46.363200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-d5eebae5-0b26-41c5-8e9a-a0ad29d54b16 req-c34ac968-4577-44f8-b9cb-87d0a6426484 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039757 Aug 31 09:47:46.363804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 123/249] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:46.591486 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:46.592037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:46.598916 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.599458 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.599907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.600786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.601330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.601764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.708997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:46.711584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:46.720828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.722063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.722932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.723853 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.724499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.725249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:46.754154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:46.763812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0563dad7-6b18-41bd-8d56-a92c373f1080 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.176414 Aug 31 09:47:46.775207 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 127/250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:46 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:46.906294 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:46.913912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-05d3a72c-51fd-41e7-a4b9-0daf12c3f524 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.214293 Aug 31 09:47:46.914477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 124/251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:46 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:46.992276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:46.992878 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:46.998840 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:46.999324 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:46.999758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.000436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.000891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.001335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.157652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:47.165373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-397dbc89-a1ed-4c8e-8a7f-11fabcfb960e tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.176977 Aug 31 09:47:47.165945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 128/252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:46 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:47.270621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:47.271225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:47.277326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.277800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.278224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.278908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.279349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.279763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.284468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:47.593258 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:47.601195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:47.602744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:47.603920 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b8729ac2-4ebc-4dee-be96-e703a480ad68 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1599 microversion: 2.20 time: 0.337348 Aug 31 09:47:47.604481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 125/253] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:47:47 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1599 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:47.627464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:47.627962 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:47.634223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.634712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.635150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.635853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.636304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.636726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.755491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7eb5a22a-927c-4538-a94f-c79741b561e4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.132424 Aug 31 09:47:47.756079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 129/254] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Aug 31 09:47:47 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:47:47.784458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:47.785129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:47.792280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.793017 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.793459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.794159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.794617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.795040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.939738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:47.940708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:47.947453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.948515 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.949283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.950216 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:47.951060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:47.951806 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:47.955889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:47.990871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-257a7405-36c6-4679-86a0-83ade7a3dfff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.210481 Aug 31 09:47:47.991795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 126/255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:47 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:48.188229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:48.190470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:48.215315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:48.216158 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:48.217612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:48.218702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:48.219473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:48.220334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:48.321663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:48.331450 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9b0785c9-42a0-4090-826b-be979d20b0e1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.395668 Aug 31 09:47:48.338610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 130/256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:47 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:48.439722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:48.449844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-28fc5c60-0696-456b-b90b-79899845c428 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.267583 Aug 31 09:47:48.450436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 127/257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:48 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:49.011458 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.012054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:49.022566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.023608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.024036 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.024896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.025515 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.026097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.263969 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:49.273005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-734977cc-b4b8-4f96-b435-41e059a8ef6d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.265202 Aug 31 09:47:49.274596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 131/258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:49.352995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.353619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:49.360717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.361336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.361828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.362752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.363293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.363783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.431870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-61164d65-7350-434a-9f4d-ca959f0d1bfb req-addf08bd-9cef-477c-9596-ca57419c559a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:49.444428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-61164d65-7350-434a-9f4d-ca959f0d1bfb req-addf08bd-9cef-477c-9596-ca57419c559a service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.445371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-61164d65-7350-434a-9f4d-ca959f0d1bfb req-addf08bd-9cef-477c-9596-ca57419c559a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.445954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-61164d65-7350-434a-9f4d-ca959f0d1bfb req-addf08bd-9cef-477c-9596-ca57419c559a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.459939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-61164d65-7350-434a-9f4d-ca959f0d1bfb req-addf08bd-9cef-477c-9596-ca57419c559a service nova] Creating event network-changed:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:47:49.469163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-61164d65-7350-434a-9f4d-ca959f0d1bfb req-addf08bd-9cef-477c-9596-ca57419c559a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037929 Aug 31 09:47:49.474033 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 132/259] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:49.482333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.483099 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:49.489979 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.490477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.490911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.491605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:49.492061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:49.492488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:49.505678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:49.513639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e3c2ff85-4b8b-4f44-8fd7-c1236537f90a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.164542 Aug 31 09:47:49.514251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 128/260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:49.637401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:49.645519 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a6a97aa1-f9a3-443e-91d8-6ae6b338ae9a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.170192 Aug 31 09:47:49.646095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 133/261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:50.298628 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:50.303528 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:50.311299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.312176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.312994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.314003 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.315259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.315851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.534551 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:50.535166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:50.545041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.545546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.545985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.552353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.552846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.553320 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.594924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:50.607094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-45685b82-f3b5-43ff-b64b-03812415145b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.317288 Aug 31 09:47:50.609928 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 129/262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:50 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:50.666574 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:50.667352 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:50.689400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.690311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.691290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.692142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.695044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.695588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.867402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:50.877301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-91b4ff79-36c7-4b69-a686-5753cca95aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.346632 Aug 31 09:47:50.890552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 134/263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:50 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:50.900310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-f60d0131-ccab-4fe4-96d1-82824f89ab1b req-e39a50dc-167d-4598-a9dc-f0cd2a3b08a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d0bc15-4bb1-46c5-82f5-ad82d487a65e", "name": "network-vif-plugged", "status": "completed", "tag": "f2d9c453-c42a-42fe-9b7a-22639ee0f7fe"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:50.915221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f60d0131-ccab-4fe4-96d1-82824f89ab1b req-e39a50dc-167d-4598-a9dc-f0cd2a3b08a0 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:50.915221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f60d0131-ccab-4fe4-96d1-82824f89ab1b req-e39a50dc-167d-4598-a9dc-f0cd2a3b08a0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:50.915221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f60d0131-ccab-4fe4-96d1-82824f89ab1b req-e39a50dc-167d-4598-a9dc-f0cd2a3b08a0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:50.948018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-f60d0131-ccab-4fe4-96d1-82824f89ab1b req-e39a50dc-167d-4598-a9dc-f0cd2a3b08a0 service nova] Creating event network-vif-plugged:f2d9c453-c42a-42fe-9b7a-22639ee0f7fe for instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e on hv-cinder-83754 Aug 31 09:47:50.964287 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-f60d0131-ccab-4fe4-96d1-82824f89ab1b req-e39a50dc-167d-4598-a9dc-f0cd2a3b08a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068858 Aug 31 09:47:50.966472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 135/264] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:51.039598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:51.047812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2acc5d76-ab4c-4b22-91a9-019ecd6e4369 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.385114 Aug 31 09:47:51.048424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 130/265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:50 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:51.633877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:51.634664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:51.642715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:51.643489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:51.644147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:51.645264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:51.646307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:51.646976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:51.791222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:51.800057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-84d48107-bbec-4deb-aa74-43547fe0f3d2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.172834 Aug 31 09:47:51.800621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 136/266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:51 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:51.881722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:51.882222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:51.888707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:51.889220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:51.889647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:51.890383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:51.890835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:51.891257 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:51.902396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:51.903217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:51.913228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:51.914072 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:51.914184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:51.914849 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:51.915305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:51.915726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:51.925267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:47:52.097546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-475511f7-c2ac-4c13-9944-8adb6298d813 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 204 len: 0 microversion: 2.1 time: 0.219503 Aug 31 09:47:52.098896 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 131/267] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:47:51 2022] DELETE /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:47:52.106283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:52.107568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:52.120276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:52.121216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:52.121684 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:52.122406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:52.122997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:52.123424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:52.311897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:52.320791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f315fefc-fc8e-4ff0-8e1c-4205b3edb402 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1363 microversion: 2.1 time: 0.220434 Aug 31 09:47:52.321929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 132/268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:52 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:52.329962 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:52.339333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5fc9fd49-0b99-4ce4-a0b9-c5360207ae69 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.440750 Aug 31 09:47:52.339917 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 137/269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:51 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:52.349195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:52.349195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:52.363145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:52.363867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:52.364393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:52.365227 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:52.365898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:52.366530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:52.532651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:52.543063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9269f815-56e6-4460-a90a-ba6fda7f859e tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.219871 Aug 31 09:47:52.543816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 133/270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:52 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:52.822516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:52.824392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:52.837914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:52.838630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:52.839170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:52.840074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:52.841047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:52.841495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:52.980856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:52.983249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:52.992386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e09639dd-f97a-42f7-9a11-ac5476c6717a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.175013 Aug 31 09:47:52.993479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 138/271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:52 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:53.343184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:53.344048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:53.357490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.358194 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.359346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.360214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.360746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.361271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.362915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:53.363483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:53.381025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.381672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.382123 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.383202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.383863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.391150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.522079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:53.529690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0db36f05-5ada-489e-903b-6450ac821e57 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1548 microversion: 2.1 time: 0.190994 Aug 31 09:47:53.530290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:53 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:53.551272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:53.551755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:53.555211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:53.557600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.558079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.558504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.559197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.559660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.560061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.566537 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ff3a13bf-4e73-4fa7-8814-191642874757 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.208682 Aug 31 09:47:53.567120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:53 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:53.571937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:53.572531 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:53.578362 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.578850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.579280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.579962 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:53.580584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:53.581042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:53.638894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bf96d82a-1657-4c22-9de3-bb4e49328d00 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091301 Aug 31 09:47:53.639491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 135/274] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:47:53 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:53.719676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:53.728113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ba24cefd-dd78-4f53-ad89-4e65d578a8bd tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.159893 Aug 31 09:47:53.728781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 140/275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:53 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:54.015713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:54.016316 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:54.023672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:54.024157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:54.024796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:54.025593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:54.025987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:54.026403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:54.385359 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:54.393206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-83175832-eabb-4d1c-86bf-c1585109d0b3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.381849 Aug 31 09:47:54.393784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 136/276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:54 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:54.587714 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:54.588437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:54.595408 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:54.595998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:54.596490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:54.597279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:54.597815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:54.598296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:54.730613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:54.738382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0be46377-1413-43ad-a223-1abbb195c695 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.154503 Aug 31 09:47:54.739043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 141/277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:54 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:54.749392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:54.750180 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:54.756430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:54.756898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:54.757394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:54.758267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:54.758859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:54.759279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:55.012909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:55.022650 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7d8f8917-0ec5-4514-bb54-62794ffe79bb tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.277330 Aug 31 09:47:55.023251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 137/278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:54 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:55.247517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-d729cfee-443c-4989-a130-1a24609c9a0f req-424dbd00-476f-43d9-8cc1-42c0ab8f13b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0d2303-37de-40e0-b537-804a86067dee", "tag": "f09361e0-942b-40ba-a8e3-5c45f1f23504"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:55.257322 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d729cfee-443c-4989-a130-1a24609c9a0f req-424dbd00-476f-43d9-8cc1-42c0ab8f13b0 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:55.257924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d729cfee-443c-4989-a130-1a24609c9a0f req-424dbd00-476f-43d9-8cc1-42c0ab8f13b0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:55.258360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d729cfee-443c-4989-a130-1a24609c9a0f req-424dbd00-476f-43d9-8cc1-42c0ab8f13b0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:55.272692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-d729cfee-443c-4989-a130-1a24609c9a0f req-424dbd00-476f-43d9-8cc1-42c0ab8f13b0 service nova] Creating event network-changed:f09361e0-942b-40ba-a8e3-5c45f1f23504 for instance 1e0d2303-37de-40e0-b537-804a86067dee on hv-cinder-83754 Aug 31 09:47:55.277841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-d729cfee-443c-4989-a130-1a24609c9a0f req-424dbd00-476f-43d9-8cc1-42c0ab8f13b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034385 Aug 31 09:47:55.278444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 142/279] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:55.414351 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:55.414951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:55.421600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:55.422355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:55.422982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:55.423709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:55.424161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:55.424580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:55.582583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:55.593126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0276d571-c162-4e5c-93be-f2288b02f9fb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1321 microversion: 2.1 time: 0.182167 Aug 31 09:47:55.605743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 138/280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:55 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:55.761135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:55.761764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:55.774415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:55.775119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:55.775608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:55.776311 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:55.776773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:55.777223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:55.950236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:55.960644 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d3c12c5f-224a-4900-90b2-873e4dfa5049 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.204477 Aug 31 09:47:55.969519 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 143/281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:55 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:56.044195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:56.044802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:56.051101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.051930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.052523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.053245 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.053694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.054176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.220512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:56.234588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-63797845-a782-4004-8e6b-b999877215cc tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.193632 Aug 31 09:47:56.247746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 139/282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:56 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:56.623250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:56.624730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:56.631391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.632336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.632872 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.633880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.634535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.635681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.806193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:56.814841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b4871c86-ffe4-4bf9-b9bf-2d15f1790a81 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1516 microversion: 2.1 time: 0.196800 Aug 31 09:47:56.815415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 144/283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:56 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:56.836675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:56.839097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:56.847833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.848318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.848748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.849474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.849925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.850355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.869567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:56.877248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lazy-loading 'flavor' on Instance uuid a9370735-2f4f-4598-97c7-d2cf483e6938 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:47:56.986142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:56.986890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:56.989390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c5ec7904-5a7d-4dfb-8298-dead0789316d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938/action" status: 200 len: 32 microversion: 2.1 time: 0.156774 Aug 31 09:47:56.990219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 140/284] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:47:56 2022] POST /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:47:56.994923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.995510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.996021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:56.996793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:56.997389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:56.997886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:57.000940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:57.001774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:57.008623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:57.009189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:57.009638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:57.010501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:57.010965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:57.011390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:57.141995 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:57.149742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4c6c044c-2489-467c-a597-228644b5f1f4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.169438 Aug 31 09:47:57.150352 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 145/285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:56 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:57.151398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:57.159499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-794cf0f9-9445-4dce-abd8-f7ed58d9dce7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.163520 Aug 31 09:47:57.160062 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 141/286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:56 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:57.261485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:57.262423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:57.269088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:57.269578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:57.270013 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:57.270742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:57.271199 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:57.271624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:57.418811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:57.427142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-73744734-a06c-4c54-b8f1-b5fae6c03750 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.171014 Aug 31 09:47:57.427791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 146/287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:57 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:58.172064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:58.172668 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:58.180489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:58.180842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:58.181294 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:58.181424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:58.181520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:58.182114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:58.182566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:58.182988 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:58.187467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:58.187959 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:58.188392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:58.189144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:58.189604 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:58.190032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:58.319785 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:58.328389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-45ac71be-0ced-4c18-aa29-44832f54e3bb tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.151338 Aug 31 09:47:58.329274 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 147/288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:58 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:47:58.355212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:58.362746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f398a413-78e9-4a17-9e48-336f8366c776 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.194535 Aug 31 09:47:58.363317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 142/289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:58 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:58.447904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:58.448512 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:58.455331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:58.455847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:58.456283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:58.456989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:58.457438 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:58.457861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:58.588710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:58.598226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ebb9e497-62e7-4759-b89f-35c5f1f32760 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.154398 Aug 31 09:47:58.598920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 148/290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:58 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:59.350746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:59.351956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:59.361238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:59.368600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:59.369353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:59.371071 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:59.372237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:59.373115 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:59.385136 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:59.385914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:59.401689 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:59.402396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:59.402856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:59.411116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:59.411608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:59.412555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:59.689663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:59.703929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-85baee70-51d3-45ac-9a5d-7d51da04395b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1366 microversion: 2.1 time: 0.321452 Aug 31 09:47:59.706155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 149/291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:59 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:59.713249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:59.714365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:47:59.724119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:59.725550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:59.726344 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:59.727252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:59.727890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:59.728326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:59.820836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:59.831492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d8ec768b-6a57-4515-9aae-3b171a2255b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.484064 Aug 31 09:47:59.831492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 143/292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:59 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:47:59.901902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:47:59.910660 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a1128149-fcb9-4964-99d9-271a937007cf tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1553 microversion: 2.1 time: 0.203271 Aug 31 09:47:59.911221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 150/293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:47:59 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:00.283129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-8b66bc2c-fe01-40ca-9789-6c04ebbf5888 req-3af605c3-ca49-4a55-bf50-3b197f30e62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc5c963-21d3-40d1-9e50-7ea8bd737dc1", "name": "network-vif-deleted", "tag": "f6b2dd7f-fff8-4a07-910d-50ac5cbd3de0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:00.295253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-8b66bc2c-fe01-40ca-9789-6c04ebbf5888 req-3af605c3-ca49-4a55-bf50-3b197f30e62d service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.296446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-8b66bc2c-fe01-40ca-9789-6c04ebbf5888 req-3af605c3-ca49-4a55-bf50-3b197f30e62d service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.296879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-8b66bc2c-fe01-40ca-9789-6c04ebbf5888 req-3af605c3-ca49-4a55-bf50-3b197f30e62d service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:00.310515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-8b66bc2c-fe01-40ca-9789-6c04ebbf5888 req-3af605c3-ca49-4a55-bf50-3b197f30e62d service nova] Creating event network-vif-deleted:f6b2dd7f-fff8-4a07-910d-50ac5cbd3de0 for instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 on hv-cinder-83754 Aug 31 09:48:00.320688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-8b66bc2c-fe01-40ca-9789-6c04ebbf5888 req-3af605c3-ca49-4a55-bf50-3b197f30e62d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043968 Aug 31 09:48:00.322358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 144/294] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:00.728805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:00.730466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:00.738891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.739655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.740370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:00.741346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.742003 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.742651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:00.875895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:00.877423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:00.892354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.893433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.894097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:00.895093 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.895967 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.901516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:00.962331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:00.974679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-30a4e864-1cd8-4426-b336-5dd03752ff77 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1556 microversion: 2.1 time: 0.250614 Aug 31 09:48:00.976623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 151/295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:00 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:00.984834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:00.985653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:00.993111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.993824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.994510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:00.996253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:00.997193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:00.997835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:01.068085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:01.077937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-dae8d7c6-1473-4b05-a6ac-aab6795bee18 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1345 microversion: 2.1 time: 0.100101 Aug 31 09:48:01.078890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 152/296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:00 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:01.084204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:01.085224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:01.102425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:01.103231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:01.103668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:01.104536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:01.105023 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:01.105477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:01.188472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fdd99f04-b9df-4e5d-b96a-1b44ae21152c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108430 Aug 31 09:48:01.189104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 153/297] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:48:01 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:01.500158 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:01.510905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a1d70872-9c23-4a46-adac-40759f31b18a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.662971 Aug 31 09:48:01.511817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 145/298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:00 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:02.101280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:02.102639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:02.108842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.109555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.110041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.110665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.111108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.111696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.166186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.166576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.167300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.167932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lazy-loading 'fault' on Instance uuid 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:48:02.261211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9f29fab9e24e98a632416f2160182c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3531fb48774df8a26ee722f3eb837e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:02.272794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-99ae96d6-6a52-44de-a9b7-b750f6f92ca8 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 200 len: 1350 microversion: 2.1 time: 0.174150 Aug 31 09:48:02.273703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 154/299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:02 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 1350 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:02.533309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:02.534634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:02.541435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.542405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.543034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.544573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.545246 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.545902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.761044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-5a1d8433-fd11-438b-8312-3a1cc44e764e req-6e03e2b8-eb54-41c4-bc32-5bfc4d76028a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d0bc15-4bb1-46c5-82f5-ad82d487a65e", "tag": "f2d9c453-c42a-42fe-9b7a-22639ee0f7fe"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:02.779279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-5a1d8433-fd11-438b-8312-3a1cc44e764e req-6e03e2b8-eb54-41c4-bc32-5bfc4d76028a service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.781398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-5a1d8433-fd11-438b-8312-3a1cc44e764e req-6e03e2b8-eb54-41c4-bc32-5bfc4d76028a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.783213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-5a1d8433-fd11-438b-8312-3a1cc44e764e req-6e03e2b8-eb54-41c4-bc32-5bfc4d76028a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.811001 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-5a1d8433-fd11-438b-8312-3a1cc44e764e req-6e03e2b8-eb54-41c4-bc32-5bfc4d76028a service nova] Creating event network-changed:f2d9c453-c42a-42fe-9b7a-22639ee0f7fe for instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e on hv-cinder-83754 Aug 31 09:48:02.820591 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-5a1d8433-fd11-438b-8312-3a1cc44e764e req-6e03e2b8-eb54-41c4-bc32-5bfc4d76028a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064523 Aug 31 09:48:02.821244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 155/300] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:02.832159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:02.841309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-87f3ef8a-75ee-47a3-b803-b9d804810b98 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.312822 Aug 31 09:48:02.842404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 146/301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:02 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:03.298095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:03.298939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:03.309142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:03.309919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:03.310618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:03.313327 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:03.314429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:03.314933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:03.347614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] HTTP exception thrown: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Request method failure captured: Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 HTTP/1.1 Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy3sBXsC1FyqyKmXbbZD8cbyaBD0o5jgoUiQc_Lxauoo4Av_sCdDGf5lYx8fjm70RC6tgvwucmEfmFZU-sCXRQ7jQM13iUPT8hm5q4XKFDAvb2iFb0FreUnacXZAAB7hMQG2Z7y0EN0v2WouncvuVoKtdXROf5s2clQrBuOSOAKFEFE Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:48:03.354521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f3531fb48774df8a26ee722f3eb837e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 5b9f29fab9e24e98a632416f2160182c Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.356272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '3dc5c963-21d3-40d1-9e50-7ea8bd737dc1'} Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:03.357047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.358413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.360981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Returning 404 to user: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:03.362381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b471f46c-14ea-41a7-8e9c-bfe52ee137a4 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 404 len: 111 microversion: 2.1 time: 0.070985 Aug 31 09:48:03.379782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 156/302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:03 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:03.495653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:03.497882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:03.505749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:03.506577 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:03.507263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:03.508152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:03.508790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:03.509421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:03.524703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] HTTP exception thrown: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Request method failure captured: Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1/os-volume_attachments HTTP/1.1 Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy3sBXsC1FyqyKmXbbZD8cbyaBD0o5jgoUiQc_Lxauoo4Av_sCdDGf5lYx8fjm70RC6tgvwucmEfmFZU-sCXRQ7jQM13iUPT8hm5q4XKFDAvb2iFb0FreUnacXZAAB7hMQG2Z7y0EN0v2WouncvuVoKtdXROf5s2clQrBuOSOAKFEFE Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:48:03.529861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f3531fb48774df8a26ee722f3eb837e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 5b9f29fab9e24e98a632416f2160182c Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.532011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'server_id': '3dc5c963-21d3-40d1-9e50-7ea8bd737dc1'} Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:03.532811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:03.534579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:03.535972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Returning 404 to user: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:03.535972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3f3f941d-01ec-4283-9df8-34f0c43f0b8a tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043264 Aug 31 09:48:03.536498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 147/303] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:48:03 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:03.863416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:03.864109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:03.870724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:03.871379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:03.871989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:03.872686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:03.873298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:03.873754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:03.890945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:04.016095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:04.023904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3e095b9d-bd02-4a0e-9918-ae48694bf27b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.164378 Aug 31 09:48:04.037209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 157/304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:03 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:05.046458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:05.047106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:05.054646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:05.055126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:05.055556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.056242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:05.056691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:05.057165 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.200380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:05.208678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d9c37ea6-d981-4471-a2ac-e4f098917e70 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.166203 Aug 31 09:48:05.209609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 148/305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:05 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:05.841052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:05.841751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:05.844581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:05.849875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:05.850462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:05.850987 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.851771 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:05.852431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:05.852864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.867313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] HTTP exception thrown: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Request method failure captured: Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 HTTP/1.1 Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy3sBXsC1FyqyKmXbbZD8cbyaBD0o5jgoUiQc_Lxauoo4Av_sCdDGf5lYx8fjm70RC6tgvwucmEfmFZU-sCXRQ7jQM13iUPT8hm5q4XKFDAvb2iFb0FreUnacXZAAB7hMQG2Z7y0EN0v2WouncvuVoKtdXROf5s2clQrBuOSOAKFEFE Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:48:05.868931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f3531fb48774df8a26ee722f3eb837e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 5b9f29fab9e24e98a632416f2160182c Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.870197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '3dc5c963-21d3-40d1-9e50-7ea8bd737dc1'} Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:05.870971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.871994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.873203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Returning 404 to user: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:05.873203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-544287ef-142a-430e-85f2-867f6a9ccf34 tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 404 len: 111 microversion: 2.1 time: 0.033147 Aug 31 09:48:05.873203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 158/306] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:48:05 2022] DELETE /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:05.878760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:05.879364 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] [instance: 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:05.885422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:05.885901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:05.886330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.887011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:05.887459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:05.887875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.901203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] HTTP exception thrown: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Request method failure captured: Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 HTTP/1.1 Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy3sBXsC1FyqyKmXbbZD8cbyaBD0o5jgoUiQc_Lxauoo4Av_sCdDGf5lYx8fjm70RC6tgvwucmEfmFZU-sCXRQ7jQM13iUPT8hm5q4XKFDAvb2iFb0FreUnacXZAAB7hMQG2Z7y0EN0v2WouncvuVoKtdXROf5s2clQrBuOSOAKFEFE Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:48:05.903381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f3531fb48774df8a26ee722f3eb837e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f3531fb48774df8a26ee722f3eb837e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 3f3531fb48774df8a26ee722f3eb837e Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-DeleteServersTestJSON-1937321445 Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 5b9f29fab9e24e98a632416f2160182c Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-DeleteServersTestJSON-1937321445-project Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.905326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '3dc5c963-21d3-40d1-9e50-7ea8bd737dc1'} Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:05.906152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. Aug 31 09:48:05.907447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:48:05.908615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] Returning 404 to user: Instance 3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:05.908615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-28a009a0-91cd-45b4-8c51-aadf54c40f1c tempest-DeleteServersTestJSON-1937321445 tempest-DeleteServersTestJSON-1937321445-project] 10.222.0.25 "GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1" status: 404 len: 111 microversion: 2.1 time: 0.029800 Aug 31 09:48:05.908615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 149/307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:05 2022] GET /compute/v2.1/servers/3dc5c963-21d3-40d1-9e50-7ea8bd737dc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:06.233421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:06.234192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:06.241972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:06.242485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:06.242911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:06.243774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:06.244223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:06.244649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:06.763302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:06.771015 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4df67064-6b42-4335-9efb-47eecefbac67 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.545367 Aug 31 09:48:06.771600 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 159/308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:06 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:07.791737 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:07.792349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:07.804153 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:07.804666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:07.805623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:07.809947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:07.810597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:07.812542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:08.032061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:08.040424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2c706657-af59-46cf-8912-1b66e396c2ac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.252588 Aug 31 09:48:08.041242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 150/309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:07 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:09.064836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:09.065538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:09.076091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:09.077365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:09.077808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:09.078907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:09.079049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:09.079376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:09.354297 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:09.368800 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8960c2cd-08aa-4817-9569-f554694e7dff tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.307820 Aug 31 09:48:09.370171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 160/310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:09 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:10.390331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:10.391097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:10.397835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:10.398319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:10.398753 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:10.399450 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:10.399904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:10.400326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:10.543133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:10.551472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-953c0cd6-c728-4825-80d6-eead4b2d0fc0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.165330 Aug 31 09:48:10.551991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 151/311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:10 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:11.575821 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:11.577194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:11.596796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:11.597387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:11.598077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:11.598946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:11.599617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:11.600059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:11.765490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:11.773239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0242030c-0491-438e-baf9-fcd216edeb3e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.203361 Aug 31 09:48:11.773971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 161/312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:11 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:12.795817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:12.797010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:12.804996 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:12.805288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:12.805894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:12.807055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:12.807675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:12.808262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:12.975393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:12.984491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-06e0e220-e46a-4ef4-934f-9c1ca3811b31 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.192618 Aug 31 09:48:12.985182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 152/313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:12 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:14.005923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:14.006533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:14.012257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:14.012975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:14.013415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:14.014737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:14.015219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:14.015618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:14.255822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:14.264312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-885e4b24-6516-49ee-bfb6-af9223ec9219 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.262233 Aug 31 09:48:14.264849 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 162/314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:14 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:15.286183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:15.287284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:15.294769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:15.295448 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:15.296101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:15.297425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:15.298214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:15.298676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:15.438937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:15.448106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d246a956-7b64-461f-9581-6d16607ad070 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.166420 Aug 31 09:48:15.448825 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 153/315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:15 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:16.468918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:16.469544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:16.475463 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:16.475944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:16.476369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.477077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:16.477525 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:16.477944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.615025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:16.624380 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-db4f1753-8b87-420c-9347-b71ccfdc6b16 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.159271 Aug 31 09:48:16.629144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 163/316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:16 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:17.645400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:17.646092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:17.651828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.653901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:17.654395 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:17.654906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:17.655528 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:17.656288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:17.656722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:17.795691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:17.804177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fb7b2eaf-2e24-461f-900c-3d047605ebaa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.162599 Aug 31 09:48:17.805100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 154/317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:17 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:18.827476 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:18.828827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:18.835498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:18.836346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:18.836854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:18.837830 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:18.838366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:18.838894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:18.977687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:18.986282 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-117eac3b-7e8c-4cc7-a812-c6cd265486a4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.164211 Aug 31 09:48:18.986864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 164/318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:18 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:20.007690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:20.008433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:20.014727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:20.015214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:20.015849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:20.016550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:20.017034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:20.017460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:20.153665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:20.162136 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-73d42ff3-62e8-4eb0-b60f-5f8c409194ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.158437 Aug 31 09:48:20.162704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 155/319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:20 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:21.183440 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:21.184060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:21.190742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:21.191225 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:21.191657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:21.192335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:21.192785 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:21.193514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:21.323969 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:21.331602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0f1c4cbe-edd8-42fa-9767-6cca3c1c60ed tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.152030 Aug 31 09:48:21.332163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 165/320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:21 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:22.352997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.353539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:22.360660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.361184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.361618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.362344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.362792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.363240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.492540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:22.501682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-53818552-a343-40b2-ad7e-95aa5a5e22c0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.152588 Aug 31 09:48:22.502335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 156/321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:22 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:23.522679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:23.523292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:23.529827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:23.530320 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:23.530759 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:23.531452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:23.531911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:23.532341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:23.667973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:23.675636 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ff118bbf-b2ea-4145-80ee-4591b8cbd668 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.156789 Aug 31 09:48:23.676196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 166/322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:23 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:24.695909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:24.696516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:24.703780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:24.704261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:24.704697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:24.705419 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:24.705874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:24.706303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:24.710292 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:24.837138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:24.845389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-59f1d3d5-c5ff-4caf-9190-1abb591467e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.153568 Aug 31 09:48:24.845953 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 157/323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:24 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:25.865978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:25.866552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:25.873364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:25.873852 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:25.874292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:25.874994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:25.875434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:25.875858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:26.003774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:26.011453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d74b2b8f-e5c0-4ecc-804d-d0c275e0d846 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.149444 Aug 31 09:48:26.012019 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 167/324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:25 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:27.033884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:27.034663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:27.042309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.042801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.043240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.043934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.044390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.044833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.175861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:27.183824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ff452f21-6607-4e14-b853-f437dd9b5798 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.155376 Aug 31 09:48:27.184389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 158/325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:27 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:28.204224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:28.204839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:28.210682 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:28.211173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:28.211831 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:28.212305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:28.212787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:28.213245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:28.338908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:28.346745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-01124fe7-8b42-4177-a081-ad1ba0a0416d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.146785 Aug 31 09:48:28.347253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 168/326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:28 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:29.366671 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:29.367207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:29.373433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:29.373912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:29.374338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:29.375014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:29.375461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:29.375878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:29.510400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:29.518508 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b9d71e25-1b40-4772-97ad-dd06f8619166 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.155704 Aug 31 09:48:29.519075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 159/327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:29 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:30.539508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:30.540114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:30.546729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:30.547203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:30.547629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:30.548302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:30.548744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:30.549195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:30.682352 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:30.690165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3a9c9599-f4c2-4797-91e6-f2ee9f6f9739 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.154467 Aug 31 09:48:30.690734 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 169/328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:30 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:31.711771 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:31.712375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:31.718325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:31.718812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:31.719250 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:31.719970 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:31.720429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:31.720855 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:31.852988 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:31.861214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-daf75148-e4cf-404c-bfdc-dfad0c4c520a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.153532 Aug 31 09:48:31.861770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 160/329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:31 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:32.881967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.882815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:32.889326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.890009 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.890526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.891226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.891837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.892321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.050653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:33.060302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9329a8f6-3161-4b76-826a-235b7b6aaffc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.182455 Aug 31 09:48:33.060861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 170/330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:32 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:34.085066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:34.086526 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:34.095916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:34.096445 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:34.097375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:34.098096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:34.098554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:34.098978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:34.265892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:34.274161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5195a918-dcc1-43d8-a3d0-efd0b0ad741f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.193629 Aug 31 09:48:34.274895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 161/331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:34 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:35.299300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.300542 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:35.306751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:35.307253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:35.307683 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:35.308382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:35.308839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:35.309690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:35.315954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=78 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:35.458817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:35.468328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-96396663-c3d1-4d32-b467-c90b07915378 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.176403 Aug 31 09:48:35.469282 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 171/332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:36.491567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.492367 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:36.499482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.499959 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.500411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.501127 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.501575 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.501990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.635596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:36.643772 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-08e1f526-82f2-4ed6-8187-9964462a93aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.156465 Aug 31 09:48:36.644333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 162/333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:37.663747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:37.664300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:37.666221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=28 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:37.671401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.671880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.672307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.672999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.673453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.673870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.807407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:37.815653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e1497691-5b01-4d80-97f5-a62f66cf002a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.155811 Aug 31 09:48:37.816212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 172/334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:37 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:38.837048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:38.837905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:38.844478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:38.844974 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:38.845448 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:38.846134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:38.846578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:38.846992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:38.975710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:38.983676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-17bed80d-988d-4537-846e-94b5d01b7029 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.150721 Aug 31 09:48:38.984232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 163/335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:38 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:40.003743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:40.004288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:40.010389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:40.010883 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:40.011323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:40.012015 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:40.012478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:40.012935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:40.152781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:40.160862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b039bcfc-0695-4ec4-b5c4-af872ed56521 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.161029 Aug 31 09:48:40.161451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 173/336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:39 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:41.183074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:41.183647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:41.191040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:41.191494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:41.191951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.193020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:41.193375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:41.193791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.343594 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:41.351293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e59fcb65-869f-45ed-9575-7de3833789d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.172455 Aug 31 09:48:41.352066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 164/337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:41 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:42.372541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:42.373109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:42.379059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:42.379551 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:42.379992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:42.380701 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:42.381185 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:42.381616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:42.515144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:42.522867 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9af2f4ac-8cac-4803-9696-11aaaef40b24 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.155107 Aug 31 09:48:42.523478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 174/338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:42 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:43.545915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:43.546519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:43.553559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.554207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.554646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.555447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.555944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.556405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.703156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:43.711379 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cd00fea8-80ec-4246-9abc-53ed2ad6d918 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1522 microversion: 2.1 time: 0.169417 Aug 31 09:48:43.712086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 165/339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:43 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:44.734378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:44.735018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:44.741403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.741901 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.742345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.743052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.743509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.743940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.872474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:44.880558 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1782e7b4-92a3-482a-99c6-e892527763ce tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1502 microversion: 2.1 time: 0.150746 Aug 31 09:48:44.881288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 175/340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:44 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:44.900587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:44.901284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:44.908651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.909193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.909632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.910332 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.910793 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.911221 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:45.058290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:45.066677 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2d9fdc2a-a821-4038-8efe-da87b1eb75bd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1517 microversion: 2.1 time: 0.170008 Aug 31 09:48:45.067251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 166/341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:44 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:47.565004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:47.567230 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.574622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.575391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.576195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.577091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.577704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.578411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.606578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lazy-loading 'flavor' on Instance uuid 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:48:47.740239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3f1e773b-a031-43c9-8b6b-815ec5c718c7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/action" status: 200 len: 32 microversion: 2.1 time: 0.179374 Aug 31 09:48:47.741572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 176/342] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:48:47 2022] POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:48:47.760442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:47.767999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.775225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=26 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:47.786487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.787023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.789146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.790740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.791814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.792769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:48.323816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:48.333894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f99f6cea-9804-448a-9271-9ed9c4f1e9a3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.583955 Aug 31 09:48:48.334701 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 167/343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:47 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:49.356328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:49.357079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:49.363240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.363720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.364152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.364844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.365318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.365735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.499129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:49.508850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-985066d6-e4e0-473f-ab64-dd62eb98bf8c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.156601 Aug 31 09:48:49.509527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 177/344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:49 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:50.529995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:50.530678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:50.537053 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.537544 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.537981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.538673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.539130 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.539560 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.670431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:50.679270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3789e7b7-0ef4-48e7-b3f4-d5b5decee0ec tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.153665 Aug 31 09:48:50.679844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 168/345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:50 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:51.701373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:51.701982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:51.707983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.708465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.708896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.709624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.710074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.710492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.846511 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:51.854250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-edb8d582-772f-4a58-819a-3ed169d9b603 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.157246 Aug 31 09:48:51.854818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 178/346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:51 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:52.875630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.876340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.882736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.883217 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.883639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.884362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.884814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.885251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.024385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:53.032297 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e2c9d90f-97c1-48b1-b8d8-556570f80855 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.161276 Aug 31 09:48:53.032861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 169/347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:54.053175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:54.053863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:54.060681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.061247 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.061757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.062674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.063140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.063541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.271605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:54.279556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-50f8c250-eed9-4aa8-a2a1-e8028a26d6bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.231069 Aug 31 09:48:54.280137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 179/348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:54 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:55.300503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:55.301447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:55.307933 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.308421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.309353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.309991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.310390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.310953 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.313551 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=77 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:55.451182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:55.459313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4f8f26bd-73f7-41fb-9bdb-7bdbb93983e2 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.163038 Aug 31 09:48:55.459976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 170/349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:55 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:56.480272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:56.481038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:56.488008 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:56.488503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:56.488938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:56.489753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:56.490209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:56.490637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:56.624481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:56.632318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-823b6871-30bd-49ba-9dcf-333ec78f8172 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.155821 Aug 31 09:48:56.632826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 180/350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:56 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:57.653624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:57.654185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:57.660444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.660917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.661378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.662051 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.662504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.662922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.804797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:57.813620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-68e89624-b98b-4988-9ea0-fa01a97d3127 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.163886 Aug 31 09:48:57.814193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 171/351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:57 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:58.840819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:58.841485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:58.847581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.848058 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.848482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.849187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.849670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.850089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.983937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:58.991731 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-adfdcc66-a9da-4115-94f6-b24cd187bc7f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.154732 Aug 31 09:48:58.992359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 181/352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:58 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:00.014194 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:00.014936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:00.021229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.021784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.022301 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.023216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.023743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.024242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.166360 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:00.174837 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a4b41f29-f7ce-443b-85b9-fa0de3f83a75 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.164924 Aug 31 09:49:00.175399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 172/353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:00 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:01.195897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:01.197089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:01.203791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.204379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.204878 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.205825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.206389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.206886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.469664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.477145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0e474866-2110-44c8-aac6-7d7de476172d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.285367 Aug 31 09:49:01.477702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 182/354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:01 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:02.498396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:02.499001 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:02.504978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.505499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.505930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.506617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.507069 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.507494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.649502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:02.658012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-330e3b94-cfab-42c4-9952-93227469edd5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.163980 Aug 31 09:49:02.658576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 173/355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:02 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:03.679599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:03.680193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:03.686957 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.687444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.687874 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.688665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.689145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.689590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.875946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:03.887900 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b68bcc52-7cb6-47ab-b573-4ed9697901cc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.212680 Aug 31 09:49:03.888656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 183/356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:03 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:04.908592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:04.909238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:04.916120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.916705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.917282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.918065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.918598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.919098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.051083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.059584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2ad0024f-b45b-4c88-a1f5-50cf384771e6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.154821 Aug 31 09:49:05.060157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 174/357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:04 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:06.081202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:06.081818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:06.088624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.089323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.090324 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.091488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.092111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.092542 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.096746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:06.225613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:06.234062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d863bd95-9c01-469b-abe1-35af3ff53fcc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.156698 Aug 31 09:49:06.234709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 184/358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:06 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:07.255329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:07.255940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:07.262748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.263190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.263748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.264533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.265031 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.265442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.394790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.403377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-430c97a6-dd9c-48f6-a435-eff73351dc57 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.151736 Aug 31 09:49:07.403991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 175/359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:07 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:08.428603 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.429475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.431686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=26 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:08.438418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.439031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.439575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.440366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.440941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.441493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.591411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:08.601225 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5ed0906e-b2cd-4d23-bc22-963ce7705cdc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.180043 Aug 31 09:49:08.613065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 185/360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:09.623413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:09.624019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:09.630554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.631043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.631482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.632166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.632618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.633063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.766539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:09.774390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a154613e-4b46-468c-8215-6be0257535de tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.155286 Aug 31 09:49:09.775109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 176/361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:09 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:10.795149 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:10.795693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:10.801716 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.802197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.802632 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.803313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.803765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.804188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.928998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.937391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ac71f0b5-e3d9-44d5-83d8-568ee629849b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.146057 Aug 31 09:49:10.937965 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 186/362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:10 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:11.959313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:11.959944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:11.966936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.967424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.967861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.968589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.969072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.969510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:12.100515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.108478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f9f7983b-ba62-423b-92b9-8b5d1875860f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.153053 Aug 31 09:49:12.109329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 177/363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:11 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:13.129312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.129961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.136059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.136560 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.137013 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.137711 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.138166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.138663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.267264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:13.274790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-33794cdb-e3fc-49ee-9167-4c15b2f331fd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.149326 Aug 31 09:49:13.275346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 187/364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:14.295903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:14.296501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:14.302733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.303212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.303637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.304319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.304766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.305209 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.430875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:14.439106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-68912370-3eb9-404b-b2ca-077b1e3a63df tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.147502 Aug 31 09:49:14.439670 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 178/365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:14 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:15.322176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1278267582", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "networks": [{"uuid": "8f3563b7-2ea7-4a98-8db0-63f48dbe5443"}]}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:15.374366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] validate_networks() for [('8f3563b7-2ea7-4a98-8db0-63f48dbe5443', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:49:15.460107 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.460709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.467639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.468123 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.468566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.469272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.469783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.470240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.597536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:15.605361 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9d65ad63-e649-440a-a1e9-80be2eafe690 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1503 microversion: 2.1 time: 0.149581 Aug 31 09:49:15.605971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 179/366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:15.625917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52b3d34f-da4e-4f3d-9760-7ec9169df663"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:15.628373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.634354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.634846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.635286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.636542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.637023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.637452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.660247 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] HTTP exception thrown: Cannot 'attach_volume' instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa while it is in vm_state rescued Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Request method failure captured: Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/os-volume_attachments HTTP/1.1 Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 74 Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy38rhyCWbhrWtX4ZXPzZ8Svs_WJ0Ldq5jcu2O8coUQH-O-yM9_WeD23tE_uxwq-ZWZox_aBUTiH8Zqr5L57Exj0BpSGO-n4ysILMuW_bASeu2tUuEPRhY8FYvcPyz2tpUQ_eNzXwkJokzuCOEJ8VBvnoGfwLJdX9b2Bb9npRJqqkaI Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:49:15.661881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089a845bce2542969b7e6f013b28d928"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089a845bce2542969b7e6f013b28d928", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 79acdbc2c11c4459928eab5b83a6755d Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {"volumeAttachment": {"volumeId": "52b3d34f-da4e-4f3d-9760-7ec9169df663"}} Aug 31 09:49:15.663490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Cannot 'attach_volume' instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa while it is in vm_state rescued Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'server_id': '6f3bc169-af8c-43fa-9d36-1dd91bfc54aa', 'body': {'volumeAttachment': {'volumeId': '52b3d34f-da4e-4f3d-9760-7ec9169df663'}}} Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:15.664308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa while it is in vm_state rescued Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:15.665536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa while it is in vm_state rescued Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Returning 409 to user: Cannot 'attach_volume' instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa while it is in vm_state rescued {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6df729b2-ad22-469a-8b06-17123ffd23c8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041202 Aug 31 09:49:15.666653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 180/367] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:49:15 2022] POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 09:49:15.672056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:15.672585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.678409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.678895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.679331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.680024 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.680482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.680908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.728021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:49:15.728446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:49:15.729095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:49:15.730182 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:49:15.730616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:49:15.742206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.742691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.743127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.743897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.744389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.744814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.747811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2066dd4f-7c27-4094-8acd-3930acb572e7 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/action" status: 202 len: 0 microversion: 2.1 time: 0.079151 Aug 31 09:49:15.748738 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 181/368] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:49:15 2022] POST /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:49:15.756813 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.757534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.762454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Getting quotas for project 036e74c1200f42aa97987e99ba3dfe85. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:15.764893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.765412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.765852 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.766546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.766972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Getting quotas for user fe99c2600f9e4b24bef88d8d76104013 and project 036e74c1200f42aa97987e99ba3dfe85. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:15.767096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.767438 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.778920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:49:15.781269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:49:15.829749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-90467eea-2cf2-4be3-94e2-a07c3cd4eaec tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511357 Aug 31 09:49:15.830392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 188/369] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:49:15.840989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a309651f-ae2b-47a3-bd2b-b108012719d0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.841822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a309651f-ae2b-47a3-bd2b-b108012719d0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.898967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a309651f-ae2b-47a3-bd2b-b108012719d0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:15.909206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a309651f-ae2b-47a3-bd2b-b108012719d0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1214 microversion: 2.1 time: 0.071925 Aug 31 09:49:15.909953 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 189/370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:15.924321 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:15.932171 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8c0fd0e7-acee-4f6f-952f-9bf642c8cebd tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1511 microversion: 2.1 time: 0.179328 Aug 31 09:49:15.933524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 182/371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:16.929599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:16.930202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:16.936481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.936986 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.937427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.938115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.938568 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.938991 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.954078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:16.954709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:16.961261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.961747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.962380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.963081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.963545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.964492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.000010 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:17.007787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a8d546f8-e3a8-414c-b87d-68e09a4925bf tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1266 microversion: 2.1 time: 0.082007 Aug 31 09:49:17.008370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 190/372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:16 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:17.099585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:17.107733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5bdab807-1f21-4e15-af6a-b81d63521ae4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1511 microversion: 2.1 time: 0.158137 Aug 31 09:49:17.108279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 183/373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:16 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:18.027646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:18.028202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:18.034172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.034748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.035188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.035882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.036338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.036828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.107979 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:18.115499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f4d72192-927a-4e60-921b-ca71b9d71d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1266 microversion: 2.1 time: 0.091813 Aug 31 09:49:18.116070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 191/374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:18 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:18.127780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:18.128414 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:18.130802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=34 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:18.136087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.136561 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.137013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.137753 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.138199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.138618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.266484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:18.274083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7704a4e7-5a28-45e9-bf2b-160f639fdc35 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1511 microversion: 2.1 time: 0.150460 Aug 31 09:49:18.274630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 184/375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:18 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:19.137369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:19.138221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:19.144310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.144804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.145279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.145972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.146433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.146863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.211943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.220568 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d77c9644-a638-4bd4-a414-242d296f3b13 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1266 microversion: 2.1 time: 0.087940 Aug 31 09:49:19.221269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 192/376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:19 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:19.294684 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:19.295290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:19.301679 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.302159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.302590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.303272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.303726 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.304142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.440277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.448111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8632bae9-793e-4cd9-98fe-206fcf7b6a36 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1511 microversion: 2.1 time: 0.157295 Aug 31 09:49:19.449434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 185/377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:19 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:20.240975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.241603 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.247693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.248186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.248665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.249466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.249933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.250363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.312284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:20.320470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-10638a59-38f3-4129-95d9-cef3f3907169 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1272 microversion: 2.1 time: 0.083292 Aug 31 09:49:20.321065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 193/378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:20.468904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.469543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.476314 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.476802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.477270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.477970 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.478429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.478859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.484186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:20.609804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:20.617548 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6ae53421-1d67-4cc6-9c8b-ca88611e0f42 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1511 microversion: 2.1 time: 0.152482 Aug 31 09:49:20.618110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 186/379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:21.342647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:21.343860 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:21.350932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.351555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.352430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.354043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.355316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.356339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.436782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:21.444733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b8fc6d6a-59da-4948-8d66-93fdf6863a4e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1272 microversion: 2.1 time: 0.107202 Aug 31 09:49:21.445411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 194/380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:21 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:21.652385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:21.656902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:21.668744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.669997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.670733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.672226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.673374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.673866 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.893430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:21.903308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e40bf3cd-a055-4f87-953c-44767e152f58 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1517 microversion: 2.1 time: 0.267754 Aug 31 09:49:21.922734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 187/381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:21 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:22.468207 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:22.468778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:22.487309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:22.490865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:22.491354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:22.492356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:22.495622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:22.496381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:22.738233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:22.752250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-24bf1c43-a7dd-4eee-8a6c-3e4a7728179f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.289370 Aug 31 09:49:22.753707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 195/382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:22 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:23.064449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-9e766fb3-a506-4dcc-8da1-c5bb12d05585 req-2fbf7a85-309b-4427-a554-10285af9d7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f6f37d-872d-4445-84fe-5b6b131d6f66", "tag": "3b2cf7ca-a053-4116-a10f-bfa922957122"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:23.085786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-9e766fb3-a506-4dcc-8da1-c5bb12d05585 req-2fbf7a85-309b-4427-a554-10285af9d7d3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.086646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-9e766fb3-a506-4dcc-8da1-c5bb12d05585 req-2fbf7a85-309b-4427-a554-10285af9d7d3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.087559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-9e766fb3-a506-4dcc-8da1-c5bb12d05585 req-2fbf7a85-309b-4427-a554-10285af9d7d3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.110464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-9e766fb3-a506-4dcc-8da1-c5bb12d05585 req-2fbf7a85-309b-4427-a554-10285af9d7d3 service nova] Creating event network-changed:3b2cf7ca-a053-4116-a10f-bfa922957122 for instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 on hv-cinder-83754 Aug 31 09:49:23.116179 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-9e766fb3-a506-4dcc-8da1-c5bb12d05585 req-2fbf7a85-309b-4427-a554-10285af9d7d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056197 Aug 31 09:49:23.117758 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 188/383] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:23.493484 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d14e274d-ee69-4911-9dc2-ea7301b51960 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'create', calling method: .version_select at 0x7f0b53f98160>, body: {"keypair": {"name": "tempest-keypair-1669790544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzpnth3Zm+KTQuibD3wxsn9sXgahssb3qOithVJ05mtGfJOHsDUvzVVTPEl6tWycih82rWVAL9WRrtBMR+cbEPodIke8CaZMJ8c0VDUi3Vjt1o/RuhBbAUyG5WnrS5G8Q=="}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:23.509707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-d14e274d-ee69-4911-9dc2-ea7301b51960 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for project 089a845bce2542969b7e6f013b28d928. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:23.516663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-d14e274d-ee69-4911-9dc2-ea7301b51960 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for user 79acdbc2c11c4459928eab5b83a6755d and project 089a845bce2542969b7e6f013b28d928. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:23.540518 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d14e274d-ee69-4911-9dc2-ea7301b51960 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051793 Aug 31 09:49:23.541451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 196/384] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:49:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:23.776109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:23.777343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:23.789749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.790494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.791617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.792548 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.793263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.794609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.077950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:24.091385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a8c0f9e0-2290-4593-9c46-cec9087a390b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.320706 Aug 31 09:49:24.093094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 189/385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:23 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:25.113335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:25.114574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:25.122199 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.122927 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.123552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.124427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.125074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.125700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.470890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-439211810", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7ee7ccc-0c6c-4664-a1eb-32f4b3ca2837"}], "security_groups": [{"name": "tempest-securitygroup--1976653399"}], "key_name": "tempest-keypair-1669790544", "user_data": "}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:25.481416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:25.490695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fc9cd4ef-bb01-4809-a8da-82411776ac84 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.382195 Aug 31 09:49:25.503213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 197/386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:25 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:25.623713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] validate_networks() for [('b7ee7ccc-0c6c-4664-a1eb-32f4b3ca2837', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:49:26.156109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:49:26.156343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:49:26.157153 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:49:26.157876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:49:26.160034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:49:26.173115 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.173852 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.174286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.175018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.175472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.175897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.195267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for project 089a845bce2542969b7e6f013b28d928. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:26.201266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Getting quotas for user 79acdbc2c11c4459928eab5b83a6755d and project 089a845bce2542969b7e6f013b28d928. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:26.215205 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:49:26.217753 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:49:26.304265 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c9c4ffb9-c682-4012-aac6-3718b6fbeda3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.838663 Aug 31 09:49:26.310747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 190/387] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:49:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:49:26.318728 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-425a60f4-efc0-4cc1-b3d7-98dd28e46d7a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:26.320749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-425a60f4-efc0-4cc1-b3d7-98dd28e46d7a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:26.323508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:26.391341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-425a60f4-efc0-4cc1-b3d7-98dd28e46d7a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:26.405715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-425a60f4-efc0-4cc1-b3d7-98dd28e46d7a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1245 microversion: 2.1 time: 0.093049 Aug 31 09:49:26.420837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 198/388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:26 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:26.512191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:26.512800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:26.523487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.523988 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.524422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.525183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.525807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.527061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.725310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:26.737645 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9f0ca6ba-edd2-43d6-bf7e-383f05605ab5 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.226815 Aug 31 09:49:26.751312 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 191/389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:26 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:27.429462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:27.430098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:27.437497 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.437913 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.438465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.439173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.439632 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.440055 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.528336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:27.540176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3058b851-cf66-4733-aec6-4f77d2cd761d tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1241 microversion: 2.1 time: 0.116260 Aug 31 09:49:27.541506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 199/390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:27 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:27.759361 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:27.760063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:27.772122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.772894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.773508 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.774400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.775017 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.775630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.035304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:28.048091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-867e71ed-b8b3-414b-8836-1e1ef26485ef tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.291780 Aug 31 09:49:28.049306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 192/391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:27 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:28.563748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:28.564984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:28.575755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.576265 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.576700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.577617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.578844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.579827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.707528 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:28.726424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-708f81da-8ba4-4973-b319-119301c9f93b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1305 microversion: 2.1 time: 0.167028 Aug 31 09:49:28.726941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 200/392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:28 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1305 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:29.070082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:29.071240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:29.085373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.085908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.086334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.090649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.091021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.091464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.543564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-38b921ef-0d1d-4350-96e1-481ecbda85a7 req-7e084b23-c63f-4462-ae8f-21571af983ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f6f37d-872d-4445-84fe-5b6b131d6f66", "name": "network-vif-plugged", "status": "completed", "tag": "3b2cf7ca-a053-4116-a10f-bfa922957122"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:29.559924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-38b921ef-0d1d-4350-96e1-481ecbda85a7 req-7e084b23-c63f-4462-ae8f-21571af983ce service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.560555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-38b921ef-0d1d-4350-96e1-481ecbda85a7 req-7e084b23-c63f-4462-ae8f-21571af983ce service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.562120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-38b921ef-0d1d-4350-96e1-481ecbda85a7 req-7e084b23-c63f-4462-ae8f-21571af983ce service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.587369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-38b921ef-0d1d-4350-96e1-481ecbda85a7 req-7e084b23-c63f-4462-ae8f-21571af983ce service nova] Creating event network-vif-plugged:3b2cf7ca-a053-4116-a10f-bfa922957122 for instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 on hv-cinder-83754 Aug 31 09:49:29.602252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-38b921ef-0d1d-4350-96e1-481ecbda85a7 req-7e084b23-c63f-4462-ae8f-21571af983ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062263 Aug 31 09:49:29.603012 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 201/393] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:49:29.647346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:29.656668 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-40d48261-bb05-4124-9b5a-356527205dfd tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.591100 Aug 31 09:49:29.657459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 193/394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:29 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:29.753584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:29.754890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:29.774593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.777205 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.780234 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.783148 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.784142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.786720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.175330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:30.187079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4ee45107-eb35-4c49-817b-e17a673eb395 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.442703 Aug 31 09:49:30.189267 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 202/395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:29 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:30.681632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:30.684087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:30.699961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.700824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.701554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.702496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.703802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.704446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.036460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:31.046857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-86334a10-cbd3-4b97-9fd7-eadbc7d4f3f2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.372188 Aug 31 09:49:31.047969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 194/396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:30 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:31.070998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-9006abbb-fa59-4d9b-93bb-f6c77ef365eb req-2669c48b-f1a1-4c4e-bcd2-43c24b56faeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0150f767-f03e-4999-aaba-5ef9d302fa94", "tag": "d542308a-b45c-47b1-8483-16192cde0e91"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:31.083803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-9006abbb-fa59-4d9b-93bb-f6c77ef365eb req-2669c48b-f1a1-4c4e-bcd2-43c24b56faeb service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.091477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-9006abbb-fa59-4d9b-93bb-f6c77ef365eb req-2669c48b-f1a1-4c4e-bcd2-43c24b56faeb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.092059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-9006abbb-fa59-4d9b-93bb-f6c77ef365eb req-2669c48b-f1a1-4c4e-bcd2-43c24b56faeb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.114106 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-9006abbb-fa59-4d9b-93bb-f6c77ef365eb req-2669c48b-f1a1-4c4e-bcd2-43c24b56faeb service nova] Creating event network-changed:d542308a-b45c-47b1-8483-16192cde0e91 for instance 0150f767-f03e-4999-aaba-5ef9d302fa94 on hv-cinder-83754 Aug 31 09:49:31.123356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-9006abbb-fa59-4d9b-93bb-f6c77ef365eb req-2669c48b-f1a1-4c4e-bcd2-43c24b56faeb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056456 Aug 31 09:49:31.128499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 203/397] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:31.209978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:31.210948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:31.218324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.219043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.219803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.220741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.221482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.222002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.448075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:31.456653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7e7a74b7-fc0c-4ed3-b0e1-14d65dad2907 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.250747 Aug 31 09:49:31.457583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 195/398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:31 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:32.068496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:32.069537 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:32.079108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.079720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.079942 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.084144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.084772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.085246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.269850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:32.278982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-129935a9-80ed-4af0-9bf7-8b3750244206 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1314 microversion: 2.1 time: 0.214867 Aug 31 09:49:32.292381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 204/399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:32 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:32.479939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:32.480563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:32.489504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.490312 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.493539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.495075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.496176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.496916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.712498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:32.723529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5431cf6b-2fbb-41a8-af9f-81a680f9cc03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.249695 Aug 31 09:49:32.725043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 196/400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:32 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:33.106007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-380245b6-ade4-48ae-bd5d-70e93b1b2dff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Action: 'create', calling method: .version_select at 0x7f0b52b93ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2048261769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKrEYBRUvb+X4+bijJR4tlzGzmPqLNeFS1VD8d4WnLUDDLCnpgS6AbKixPohmoPPH6j/1jBy95j9HflmE7aj4eZrpzWP5AgRRIHRkaZNbjq3782QGM59KkdP5HRg7GwNQ=="}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:33.121990 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-380245b6-ade4-48ae-bd5d-70e93b1b2dff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:33.132155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-380245b6-ade4-48ae-bd5d-70e93b1b2dff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for user 5669f5e5dcd74e01b4fb7c1bd512bd82 and project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:33.154575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-380245b6-ade4-48ae-bd5d-70e93b1b2dff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.225597 Aug 31 09:49:33.155435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 205/401] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:49:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:49:33.299909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:33.300509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:33.311187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.311295 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.311716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.312509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.312946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.320096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.514250 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:33.528442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-804e462e-dabf-48e9-b96f-8b327e6f45e4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1499 microversion: 2.1 time: 0.232283 Aug 31 09:49:33.530189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 197/402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:33 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1499 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:33.744567 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:33.745220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:33.751943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.752546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.753005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.754403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.755451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.756725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.959888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:33.962568 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:33.970753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-acfbf27f-e4ea-4337-ad05-f9e3127294c4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.230809 Aug 31 09:49:33.971702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 206/403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:33 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:34.179171 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:34.179964 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:34.198261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.198576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.198927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.200081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.200827 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.201430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.235210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:49:34.327874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8d8a8215-4f27-4573-8962-5208afcaf82c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 204 len: 0 microversion: 2.1 time: 0.152601 Aug 31 09:49:34.328465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 198/404] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:34 2022] DELETE /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:49:34.337296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:34.338558 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:34.344675 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.345410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.345809 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.346549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.347027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.347431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.501066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:34.509726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-91339e15-07cc-4bdc-ac57-31e4cfb779bc tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1505 microversion: 2.1 time: 0.176500 Aug 31 09:49:34.510350 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 207/405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:34 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:34.994715 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:34.995422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.002335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.003078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.003516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.004213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.004666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.005192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.142203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:35.150674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d780ea98-cb0f-450c-99ec-232290d11042 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.160537 Aug 31 09:49:35.151262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 199/406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:34 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:35.531848 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:35.532449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.538623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.539377 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.539870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.540633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.541802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.542357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.674954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:35.683076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-816dcb6b-ef34-4855-b873-7735f93fc109 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1505 microversion: 2.1 time: 0.155053 Aug 31 09:49:35.689729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 208/407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:35 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:36.173346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:36.174356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:36.182655 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.183296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.183736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.184585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.185102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.185530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.186088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:36.211922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:36.330829 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:36.339944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-69627c40-18fb-4eff-9303-45be1775831e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.171651 Aug 31 09:49:36.340516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 200/408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:36 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:36.704413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:36.705667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:36.712002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.712513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.713000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.713701 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.714158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.714578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.860100 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:36.868189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9b323049-bb59-4c72-9563-1173297cf73e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1505 microversion: 2.1 time: 0.167717 Aug 31 09:49:36.868757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 209/409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:36 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:37.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.362717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.374319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.374863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.375305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.376218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.384700 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.385453 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.519817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:37.528110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2bb432d1-18e5-497b-8157-1267b96fa038 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.170618 Aug 31 09:49:37.528685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 201/410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:37.889961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.891177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.897280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.897762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.898192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.898889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.899343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.899762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.033943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:38.042183 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-486bd5b6-13cb-4fd9-8eed-d8403772ca2e tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1505 microversion: 2.1 time: 0.156189 Aug 31 09:49:38.042768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 210/411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:38.551593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:38.552203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.558730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.559217 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.559657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.560356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.560814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.561273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.581779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:38.700528 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:38.708019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-be6c188e-d09e-4391-b6d7-b19ae9c1e9b5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.160317 Aug 31 09:49:38.708582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 202/412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:38 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:39.062770 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:39.063382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:39.065286 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:39.071045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.071596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.072031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.073479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.074157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.074657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.309873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.317972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-93015e89-91c8-4cf1-8ea2-90235656bd92 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1505 microversion: 2.1 time: 0.259006 Aug 31 09:49:39.318552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 211/413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:39 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:39.473978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-a71cdf32-0289-4020-ba28-7fe18991a373 req-c5de97c9-bfec-4f2c-8a6e-b741f27c7305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f6f37d-872d-4445-84fe-5b6b131d6f66", "name": "network-vif-deleted", "tag": "3b2cf7ca-a053-4116-a10f-bfa922957122"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:39.483657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a71cdf32-0289-4020-ba28-7fe18991a373 req-c5de97c9-bfec-4f2c-8a6e-b741f27c7305 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.484135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a71cdf32-0289-4020-ba28-7fe18991a373 req-c5de97c9-bfec-4f2c-8a6e-b741f27c7305 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a71cdf32-0289-4020-ba28-7fe18991a373 req-c5de97c9-bfec-4f2c-8a6e-b741f27c7305 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.495777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-a71cdf32-0289-4020-ba28-7fe18991a373 req-c5de97c9-bfec-4f2c-8a6e-b741f27c7305 service nova] Creating event network-vif-deleted:3b2cf7ca-a053-4116-a10f-bfa922957122 for instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 on hv-cinder-83754 Aug 31 09:49:39.500467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-a71cdf32-0289-4020-ba28-7fe18991a373 req-c5de97c9-bfec-4f2c-8a6e-b741f27c7305 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030141 Aug 31 09:49:39.501320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 203/414] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:39.729264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:39.730091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:39.736390 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.736910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.737375 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.738284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.738745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.739167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.905957 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.917340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-dc2aa10d-a332-4d45-9b00-22b50062a167 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.192130 Aug 31 09:49:39.918044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 212/415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:39 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:40.096828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-6858c948-3e31-4bb6-a1ac-7e4046fb89d0 req-4b2f4acf-740e-44a3-9a88-585b8109a95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0150f767-f03e-4999-aaba-5ef9d302fa94", "name": "network-vif-plugged", "status": "completed", "tag": "d542308a-b45c-47b1-8483-16192cde0e91"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:40.106604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-6858c948-3e31-4bb6-a1ac-7e4046fb89d0 req-4b2f4acf-740e-44a3-9a88-585b8109a95d service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.107091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-6858c948-3e31-4bb6-a1ac-7e4046fb89d0 req-4b2f4acf-740e-44a3-9a88-585b8109a95d service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.107523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-6858c948-3e31-4bb6-a1ac-7e4046fb89d0 req-4b2f4acf-740e-44a3-9a88-585b8109a95d service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.119798 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-6858c948-3e31-4bb6-a1ac-7e4046fb89d0 req-4b2f4acf-740e-44a3-9a88-585b8109a95d service nova] Creating event network-vif-plugged:d542308a-b45c-47b1-8483-16192cde0e91 for instance 0150f767-f03e-4999-aaba-5ef9d302fa94 on hv-cinder-83754 Aug 31 09:49:40.125167 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-6858c948-3e31-4bb6-a1ac-7e4046fb89d0 req-4b2f4acf-740e-44a3-9a88-585b8109a95d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Aug 31 09:49:40.125784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 204/416] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:40.338446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.339077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.345231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.345797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.346258 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.347092 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.347552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.348090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.380025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.380520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.380978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.381433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lazy-loading 'fault' on Instance uuid a6f6f37d-872d-4445-84fe-5b6b131d6f66 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:40.433039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:40.442235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-23f7cc2b-ef7b-4c9c-bccf-efcbb1f02929 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 200 len: 1304 microversion: 2.1 time: 0.107240 Aug 31 09:49:40.443042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 213/417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:40.938884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.939578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.946028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.946515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.946951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.947638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.948095 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.948517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.080117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:41.089244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-678345c4-e0d9-46a7-8773-2b609cb18baf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.154354 Aug 31 09:49:41.089830 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 205/418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:41.465334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:41.465938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: a6f6f37d-872d-4445-84fe-5b6b131d6f66] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:41.472132 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.472608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.473061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.473741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.474189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.474606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.487928 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] HTTP exception thrown: Instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 could not be found. Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Request method failure captured: Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 HTTP/1.1 Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy6UZ03F5w93hW_lbq_kDmoqqOPreTLSzjGDe8RtXUD6n84iww57Q_OH7uv0T2eQIBkf5UIm1yJlK5LzS2tUk80tvgLaTrNAVE5HhgtV5N8WPFyKYZ1Sz8avQ568GL6IN1DLTp1ooM_7aFNG3AynbaNfAZ6LRSxiCesZXj-IhLqtqJs Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 036e74c1200f42aa97987e99ba3dfe85 Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesActionsTest-793864203 Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:49:41.489597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/036e74c1200f42aa97987e99ba3dfe85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/036e74c1200f42aa97987e99ba3dfe85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/036e74c1200f42aa97987e99ba3dfe85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_036e74c1200f42aa97987e99ba3dfe85", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesActionsTest-793864203 Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 036e74c1200f42aa97987e99ba3dfe85 Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesActionsTest-793864203 Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesActionsTest-793864203-project Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: fe99c2600f9e4b24bef88d8d76104013 Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesActionsTest-793864203-project Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 could not be found. Aug 31 09:49:41.492171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'a6f6f37d-872d-4445-84fe-5b6b131d6f66'} Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 could not be found. Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:41.493712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 could not be found. Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 could not be found. Aug 31 09:49:41.496040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:49:41.497651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Returning 404 to user: Instance a6f6f37d-872d-4445-84fe-5b6b131d6f66 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:41.497651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2d95b431-5318-4eb0-8ca5-3dafbcf7ce50 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66" status: 404 len: 111 microversion: 2.1 time: 0.030506 Aug 31 09:49:41.497651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 214/419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:41 2022] GET /compute/v2.1/servers/a6f6f37d-872d-4445-84fe-5b6b131d6f66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:41.592357 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1676860307", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "networks": [{"uuid": "8f3563b7-2ea7-4a98-8db0-63f48dbe5443"}]}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:41.646677 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] validate_networks() for [('8f3563b7-2ea7-4a98-8db0-63f48dbe5443', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:49:42.014555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:49:42.014982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:49:42.015454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:49:42.015894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:49:42.016304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:49:42.025272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.025755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.026191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.026924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.027380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.027833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.045201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Getting quotas for project 036e74c1200f42aa97987e99ba3dfe85. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:42.049103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Getting quotas for user fe99c2600f9e4b24bef88d8d76104013 and project 036e74c1200f42aa97987e99ba3dfe85. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:42.060534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:49:42.062887 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:49:42.109426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a27eb638-4114-4169-bd40-a1f0bf259e6f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520801 Aug 31 09:49:42.110104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 206/420] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:49:42.111388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:42.112136 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:42.118508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.119873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.119995 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.120691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.121411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7d187836-f18b-459b-b211-b81abf148605 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:42.121687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.122116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7d187836-f18b-459b-b211-b81abf148605 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:42.122240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.177697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7d187836-f18b-459b-b211-b81abf148605 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.186080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7d187836-f18b-459b-b211-b81abf148605 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1214 microversion: 2.1 time: 0.069283 Aug 31 09:49:42.186661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 207/421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:42 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:42.261697 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.270193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e016459b-734c-41c0-a32a-591bf39549b0 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1371 microversion: 2.1 time: 0.164139 Aug 31 09:49:42.271063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 215/422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:42 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:43.206942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.207555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.214776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.215273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.215862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.216505 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.217027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.217467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.282724 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:43.292235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.293477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.293782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4ae62e3d-dcdd-4197-8dd0-64c8dac87102 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1218 microversion: 2.1 time: 0.090559 Aug 31 09:49:43.294365 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 208/423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:43.296950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=18 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:43.300837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.301354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.301794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.302499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.302958 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.303386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.443156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:43.452201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-404a43c9-e0bb-406a-b27b-fbbcb7ed0f1b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1565 microversion: 2.1 time: 0.163985 Aug 31 09:49:43.452879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 216/424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:43.472587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.473173 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.479783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.480266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.480762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.481497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.482318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.482744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.568379 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7b5db66e-1c4c-40ee-91eb-40bc3cc46131 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099600 Aug 31 09:49:43.570525 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 209/425] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:44.315790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:44.316773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:44.322736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.323222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.323650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.324801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.325367 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.325794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.438175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:44.449007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3e5abe45-f3e9-4ee6-8803-a8a624200bb0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1274 microversion: 2.1 time: 0.136919 Aug 31 09:49:44.449985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 217/426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:44 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:44.593759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-f2627dea-6776-482d-8bd6-9052da890275 req-748c191c-c294-428e-a6fe-844bb23cecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0150f767-f03e-4999-aaba-5ef9d302fa94", "tag": "d542308a-b45c-47b1-8483-16192cde0e91"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:44.606718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-f2627dea-6776-482d-8bd6-9052da890275 req-748c191c-c294-428e-a6fe-844bb23cecd3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.607598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-f2627dea-6776-482d-8bd6-9052da890275 req-748c191c-c294-428e-a6fe-844bb23cecd3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.608254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-f2627dea-6776-482d-8bd6-9052da890275 req-748c191c-c294-428e-a6fe-844bb23cecd3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.624452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-f2627dea-6776-482d-8bd6-9052da890275 req-748c191c-c294-428e-a6fe-844bb23cecd3 service nova] Creating event network-changed:d542308a-b45c-47b1-8483-16192cde0e91 for instance 0150f767-f03e-4999-aaba-5ef9d302fa94 on hv-cinder-83754 Aug 31 09:49:44.629597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-f2627dea-6776-482d-8bd6-9052da890275 req-748c191c-c294-428e-a6fe-844bb23cecd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040057 Aug 31 09:49:44.630198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 210/427] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:45.472728 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:45.474216 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:45.481274 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.482111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.482729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.483673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.484371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.484808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.963856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:45.971647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a8580bf0-babe-41d4-92ef-18fc6da939e2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.505250 Aug 31 09:49:45.972339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 218/428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:45 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:46.113987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-d196d45e-6843-4f58-a95f-00dbe38d7771 req-b8494881-32d2-4904-a4b1-e047618825e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68fb0da0-575d-4e6c-8e2e-172743dd399e", "tag": "529b855f-f4a2-47c6-aaba-111bb12bf2fa"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:46.124199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d196d45e-6843-4f58-a95f-00dbe38d7771 req-b8494881-32d2-4904-a4b1-e047618825e6 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.124642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d196d45e-6843-4f58-a95f-00dbe38d7771 req-b8494881-32d2-4904-a4b1-e047618825e6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.125100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d196d45e-6843-4f58-a95f-00dbe38d7771 req-b8494881-32d2-4904-a4b1-e047618825e6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.136904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-d196d45e-6843-4f58-a95f-00dbe38d7771 req-b8494881-32d2-4904-a4b1-e047618825e6 service nova] Creating event network-changed:529b855f-f4a2-47c6-aaba-111bb12bf2fa for instance 68fb0da0-575d-4e6c-8e2e-172743dd399e on hv-cinder-83754 Aug 31 09:49:46.141683 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-d196d45e-6843-4f58-a95f-00dbe38d7771 req-b8494881-32d2-4904-a4b1-e047618825e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032222 Aug 31 09:49:46.142497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 211/429] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:46.994631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:46.995981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:47.002920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.003411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.003834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.004530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.005028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.005423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.139607 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:47.147471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7eeef7fe-c7b6-45e7-811e-7f4de887678b tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.157492 Aug 31 09:49:47.148041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 219/430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:46 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:48.169370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:48.170070 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:48.172289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:48.178893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.179422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.179856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.180547 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.181071 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.182039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.310181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:48.318074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-997172c0-b279-41ae-b9f8-f6fcb1492aa9 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.153911 Aug 31 09:49:48.318634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 212/431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:48 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:49.338475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:49.339008 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:49.345002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:49.345495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:49.345929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.346607 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:49.347054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:49.347474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.474009 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:49.482039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-671347d4-1085-4826-a6ac-5007add8c39d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.147551 Aug 31 09:49:49.482599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 220/432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:49 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:50.502739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:50.503323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:50.509614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.510095 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.510523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.511211 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.511676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.512089 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.642256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:50.650214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9e775593-b967-4c93-a668-26803109e272 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.150794 Aug 31 09:49:50.650783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 213/433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:50 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:51.670904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:51.671514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:51.677748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.678231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.678659 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.679342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.679795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.680218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.808579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:51.816569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-365434d3-e359-476b-95be-3ba77d1076f0 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.149219 Aug 31 09:49:51.817160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 221/434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:51 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:52.840267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.840828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.843155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:52.843896 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=8 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:52.849412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.849896 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.850339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.851026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.851482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.851905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.984083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:52.992016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-72ab751f-1ca4-479f-9738-1a9bf3ee055f tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.156224 Aug 31 09:49:52.992586 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 214/435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:54.011210 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.011811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.017851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.018333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.018763 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.019439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.019887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.020301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.152096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:54.159969 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-048719e5-af86-4388-943c-c90457074d86 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.152460 Aug 31 09:49:54.160544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 222/436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:54 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:54.864873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-3f05c371-b0bd-471c-8c91-2ca4cc7a0ea7 req-693b40db-44e8-4d7c-8865-c267109d7ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fb0da0-575d-4e6c-8e2e-172743dd399e", "name": "network-vif-plugged", "status": "completed", "tag": "529b855f-f4a2-47c6-aaba-111bb12bf2fa"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:54.875221 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3f05c371-b0bd-471c-8c91-2ca4cc7a0ea7 req-693b40db-44e8-4d7c-8865-c267109d7ed6 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.875706 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3f05c371-b0bd-471c-8c91-2ca4cc7a0ea7 req-693b40db-44e8-4d7c-8865-c267109d7ed6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.876140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3f05c371-b0bd-471c-8c91-2ca4cc7a0ea7 req-693b40db-44e8-4d7c-8865-c267109d7ed6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.887800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-3f05c371-b0bd-471c-8c91-2ca4cc7a0ea7 req-693b40db-44e8-4d7c-8865-c267109d7ed6 service nova] Creating event network-vif-plugged:529b855f-f4a2-47c6-aaba-111bb12bf2fa for instance 68fb0da0-575d-4e6c-8e2e-172743dd399e on hv-cinder-83754 Aug 31 09:49:54.892705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-3f05c371-b0bd-471c-8c91-2ca4cc7a0ea7 req-693b40db-44e8-4d7c-8865-c267109d7ed6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Aug 31 09:49:54.893337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 215/437] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:55.179739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:55.180357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:55.186618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.187116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.187535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.188242 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.188687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.189134 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.323931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:55.326195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:55.333103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-35465b77-d89a-4389-8322-979e7d131145 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.157193 Aug 31 09:49:55.333677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 223/438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:55 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:56.355729 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:56.356373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:56.363151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:56.363640 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:56.364066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.364806 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:56.365294 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:56.365714 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.497886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:56.505529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5d5da1a2-13f6-47e2-9039-f14fff6f8d41 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.155092 Aug 31 09:49:56.506099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 216/439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:56 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:57.526252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:57.526868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:57.532870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.533392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.533844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.534515 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.534973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.535401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.662847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:57.670380 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6f7c6f1a-4698-4973-9806-1fe9c5aebed4 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1314 microversion: 2.1 time: 0.148053 Aug 31 09:49:57.670944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 224/440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:57 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:58.690421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:58.691061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:58.698241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:58.698722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:58.699155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:58.699842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:58.700296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:58.700720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:58.846140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:58.853868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f10275e7-3401-4f2a-bad6-74983af02a18 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1498 microversion: 2.1 time: 0.167270 Aug 31 09:49:58.854438 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 217/441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:58 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:59.471939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:59.472466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:59.480645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.481448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.481899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.482602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.483101 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.483605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.510680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:49:59.598108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-09fa0054-c1b5-47ef-b70f-b50fdc73a43c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 204 len: 0 microversion: 2.1 time: 0.129782 Aug 31 09:49:59.598694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 225/442] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:59 2022] DELETE /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:49:59.608703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:59.609436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:59.615799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.616282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.616720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.617460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.617905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.618848 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.749236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:59.756859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-681e0f83-2341-4044-851c-740110df1f1c tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1504 microversion: 2.1 time: 0.153326 Aug 31 09:49:59.757461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 218/443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:59 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:00.779179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:00.779871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:00.785803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.786288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.786721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.787406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.787857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.788279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.916194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:00.923772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b9a9155a-cc7c-4d50-ad4b-1ef7e8ad1b4d tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1504 microversion: 2.1 time: 0.149474 Aug 31 09:50:00.924334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 226/444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:00 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:01.545940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-713241470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2048261769", "security_groups": [{"name": "tempest-secgroup-smoke-67122470"}], "block_device_mapping_v2": [{"uuid": "c808ca21-da9b-4b4c-b237-384b98ebef22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "017403cb-7130-4780-82b1-0da472342b0b"}]}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:01.658239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] validate_networks() for [('017403cb-7130-4780-82b1-0da472342b0b', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:50:01.945035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:01.945664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:01.951539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.952028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.952460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.953186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.953641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.954064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.025901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:50:02.026319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:50:02.026791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:50:02.027195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:50:02.027639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:50:02.037273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:02.037756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:02.038190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.038913 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:02.039367 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:02.040311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.057255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:02.061309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for user 5669f5e5dcd74e01b4fb7c1bd512bd82 and project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:02.087936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:02.097548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3a8da520-00d8-4c58-80ea-552667efbf26 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1504 microversion: 2.1 time: 0.156483 Aug 31 09:50:02.098229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 227/445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:01 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:02.123500 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:50:02.125673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c808ca21-da9b-4b4c-b237-384b98ebef22',volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:50:02.256323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cf8d6f0b-8223-4d11-aa0f-8e586c8517ec tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.714256 Aug 31 09:50:02.256951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 219/446] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:50:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:50:02.267968 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-00bef142-e46f-4d7c-a904-70fa3ecef9ee tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:02.268575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-00bef142-e46f-4d7c-a904-70fa3ecef9ee tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:02.320520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00bef142-e46f-4d7c-a904-70fa3ecef9ee tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:02.327807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-00bef142-e46f-4d7c-a904-70fa3ecef9ee tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1094 microversion: 2.1 time: 0.063589 Aug 31 09:50:02.328376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 228/447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:02 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:02.982796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-556b83e9-64b9-4a1d-9ee9-cc70439c6c6a req-a8a7681a-800e-4efa-832f-4a971c28fed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fb0da0-575d-4e6c-8e2e-172743dd399e", "name": "network-vif-deleted", "tag": "529b855f-f4a2-47c6-aaba-111bb12bf2fa"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:02.995084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-556b83e9-64b9-4a1d-9ee9-cc70439c6c6a req-a8a7681a-800e-4efa-832f-4a971c28fed9 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:02.995580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-556b83e9-64b9-4a1d-9ee9-cc70439c6c6a req-a8a7681a-800e-4efa-832f-4a971c28fed9 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:02.996019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-556b83e9-64b9-4a1d-9ee9-cc70439c6c6a req-a8a7681a-800e-4efa-832f-4a971c28fed9 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.007122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-556b83e9-64b9-4a1d-9ee9-cc70439c6c6a req-a8a7681a-800e-4efa-832f-4a971c28fed9 service nova] Creating event network-vif-deleted:529b855f-f4a2-47c6-aaba-111bb12bf2fa for instance 68fb0da0-575d-4e6c-8e2e-172743dd399e on hv-cinder-83754 Aug 31 09:50:03.013015 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-556b83e9-64b9-4a1d-9ee9-cc70439c6c6a req-a8a7681a-800e-4efa-832f-4a971c28fed9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Aug 31 09:50:03.013945 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 220/448] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:03.118749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:03.119351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:03.125160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.125641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.126067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.126752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.127198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.127712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.192136 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:03.200413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4450c5c8-af9d-45ed-ac7b-715361c53329 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1299 microversion: 2.1 time: 0.085536 Aug 31 09:50:03.200910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 229/449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:03 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:03.348035 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:03.348741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:03.355413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.355889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.356318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.357028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.357483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.357898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.421334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:03.429578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-630283cb-afa4-4d65-95b1-7856cae5fb61 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1192 microversion: 2.1 time: 0.085770 Aug 31 09:50:03.430171 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 221/450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:03 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:04.220436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:04.221204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:04.227118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.227602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.228073 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.228741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.229217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.229640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.260662 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.261173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.261605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.262047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lazy-loading 'fault' on Instance uuid 68fb0da0-575d-4e6c-8e2e-172743dd399e {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:50:04.300712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe99c2600f9e4b24bef88d8d76104013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036e74c1200f42aa97987e99ba3dfe85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:04.308779 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-deeb71ee-f8d1-48d1-a9b7-82c85f5ca8c2 tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 200 len: 1304 microversion: 2.1 time: 0.092275 Aug 31 09:50:04.309373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 230/451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:04 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:04.450380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:04.451010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:04.457982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.458472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.458912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.459606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.460066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.460492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.524083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:04.531840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b9ce2f94-c7a8-49dc-937c-8292225e6e84 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1210 microversion: 2.1 time: 0.085270 Aug 31 09:50:04.532436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 222/452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:04 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:05.330441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:05.331139 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] [instance: 68fb0da0-575d-4e6c-8e2e-172743dd399e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:05.338023 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.338843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.339285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.339961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.340415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.340834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.354795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] HTTP exception thrown: Instance 68fb0da0-575d-4e6c-8e2e-172743dd399e could not be found. Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Request method failure captured: Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e HTTP/1.1 Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy6UZ03F5w93hW_lbq_kDmoqqOPreTLSzjGDe8RtXUD6n84iww57Q_OH7uv0T2eQIBkf5UIm1yJlK5LzS2tUk80tvgLaTrNAVE5HhgtV5N8WPFyKYZ1Sz8avQ568GL6IN1DLTp1ooM_7aFNG3AynbaNfAZ6LRSxiCesZXj-IhLqtqJs Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 036e74c1200f42aa97987e99ba3dfe85 Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesActionsTest-793864203 Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:50:05.356421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/036e74c1200f42aa97987e99ba3dfe85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/036e74c1200f42aa97987e99ba3dfe85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/036e74c1200f42aa97987e99ba3dfe85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_036e74c1200f42aa97987e99ba3dfe85", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesActionsTest-793864203 Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 036e74c1200f42aa97987e99ba3dfe85 Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesActionsTest-793864203 Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesActionsTest-793864203-project Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: fe99c2600f9e4b24bef88d8d76104013 Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesActionsTest-793864203-project Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 68fb0da0-575d-4e6c-8e2e-172743dd399e could not be found. Aug 31 09:50:05.358004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '68fb0da0-575d-4e6c-8e2e-172743dd399e'} Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fb0da0-575d-4e6c-8e2e-172743dd399e could not be found. Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:50:05.358911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fb0da0-575d-4e6c-8e2e-172743dd399e could not be found. Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fb0da0-575d-4e6c-8e2e-172743dd399e could not be found. Aug 31 09:50:05.360385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:50:05.361670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] Returning 404 to user: Instance 68fb0da0-575d-4e6c-8e2e-172743dd399e could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:50:05.361670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9ed63468-a336-48d9-9fbf-43d9dfe76aac tempest-VolumesActionsTest-793864203 tempest-VolumesActionsTest-793864203-project] 10.222.0.25 "GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e" status: 404 len: 111 microversion: 2.1 time: 0.031531 Aug 31 09:50:05.362306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 231/453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:05 2022] GET /compute/v2.1/servers/68fb0da0-575d-4e6c-8e2e-172743dd399e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:50:05.553532 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:05.554877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:05.574811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.577909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.578430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.579444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.580118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.580732 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.792785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:05.802426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-aff0e183-81ec-413c-9ced-daafec3e85fc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1276 microversion: 2.1 time: 0.254063 Aug 31 09:50:05.803002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 223/454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:05 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:06.173339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-7b1f0edc-2a7e-46f1-b25c-8d2b5de85323 req-54a4f4ca-f29e-46ec-afd4-d24d276655b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a576c4-6c87-49fd-b00b-ea140c968c8a", "tag": "96048666-ee31-454b-8cf1-204196456392"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:06.184262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-7b1f0edc-2a7e-46f1-b25c-8d2b5de85323 req-54a4f4ca-f29e-46ec-afd4-d24d276655b3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.184875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-7b1f0edc-2a7e-46f1-b25c-8d2b5de85323 req-54a4f4ca-f29e-46ec-afd4-d24d276655b3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.185635 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-7b1f0edc-2a7e-46f1-b25c-8d2b5de85323 req-54a4f4ca-f29e-46ec-afd4-d24d276655b3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.199802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-7b1f0edc-2a7e-46f1-b25c-8d2b5de85323 req-54a4f4ca-f29e-46ec-afd4-d24d276655b3 service nova] Creating event network-changed:96048666-ee31-454b-8cf1-204196456392 for instance 68a576c4-6c87-49fd-b00b-ea140c968c8a on hv-cinder-83754 Aug 31 09:50:06.205299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-7b1f0edc-2a7e-46f1-b25c-8d2b5de85323 req-54a4f4ca-f29e-46ec-afd4-d24d276655b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036283 Aug 31 09:50:06.206048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 232/455] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:06.823413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:06.824023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:06.830362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.830870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.831302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.831987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.832437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.832858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.963261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:06.970692 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5c82f4f0-9595-49df-bee5-c1db02772e48 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.151174 Aug 31 09:50:06.971255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 224/456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:06 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:07.992130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:07.992863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:07.999089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.999580 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.000017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.000721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.001190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.001618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.134500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:08.142137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0a95bfb1-64d4-4c78-af24-5ca540e750e3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.154310 Aug 31 09:50:08.142706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 233/457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:07 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:09.162189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:09.162805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:09.169592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.170078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.170510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.171199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.171650 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.172072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.174736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=96 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:09.303654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:09.311874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f8f3282d-c59d-49d5-a31d-549f3ba86b01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.153617 Aug 31 09:50:09.312435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 225/458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:09 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:10.332420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:10.333051 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:10.335111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:10.341789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.342281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.342722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.343407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.343862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.344284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.471889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:10.479538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a88d2014-21ee-4017-afe5-7d1d0d6c1ddd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.151068 Aug 31 09:50:10.480098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 234/459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:10 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:10.829910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:10.830457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:10.836794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.837309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.837744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.838429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.838880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.839306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.862153 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-20242b69-7f30-4bcc-be02-f3c8d0d32cc9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/ips" status: 200 len: 151 microversion: 2.20 time: 0.035858 Aug 31 09:50:10.863084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 226/460] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Aug 31 09:50:10 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:50:11.499712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:11.500355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:11.506435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:11.506924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:11.507368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:11.508062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:11.508521 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:11.508947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:11.637404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:11.647082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-47b7d6de-f700-4a82-8093-1a025388d824 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.151351 Aug 31 09:50:11.647644 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 235/461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:11 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:12.049789 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:12.050325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:12.052519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:12.057878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.058367 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.058805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.059499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.059956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.060381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.075242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:12.085347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-67840a5d-efa8-4d90-aa2f-80cb8aa667ca tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/ips" status: 200 len: 144 microversion: 2.1 time: 0.039541 Aug 31 09:50:12.085929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 227/462] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:50:12 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:12.669472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:12.669875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:12.671744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:12.677096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.677584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.678018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.678702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.679157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.679584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.827251 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:12.835822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4742b63c-605e-4637-8e3e-7c4da7fa2b6e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.171739 Aug 31 09:50:12.837027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 236/463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:12 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:13.858136 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:13.860345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:13.867237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.867810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.868307 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.869104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.869807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.870293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.013259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:14.021128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d89f54bd-6d9e-481c-9e0f-f8b2ad539318 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.166834 Aug 31 09:50:14.021630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 228/464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:13 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:14.985679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:14.986208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:14.992190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.992678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.993152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.993844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.994329 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.994755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.017715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lazy-loading 'flavor' on Instance uuid 0fb4356f-6089-4087-9f63-a48ff6bcb08a {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:50:15.042877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:15.043485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:15.049834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:15.050318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:15.051047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.051752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:15.052207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:15.052627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.202773 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.212847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-da42d4bf-fb56-48f7-997b-b52b66247bfd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.174631 Aug 31 09:50:15.213459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 229/465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:15 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:15.289647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0c780e16-9f91-42ba-b8d4-0ced402a87bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/action" status: 202 len: 0 microversion: 2.20 time: 0.307608 Aug 31 09:50:15.293491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 237/466] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 31 09:50:14 2022] POST /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:50:15.299129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:15.299869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:15.309314 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:15.310917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:15.312563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.313648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:15.315756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:15.317389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.507407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.516667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.518336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.519581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fcc24423-27a3-41fe-9f75-3f8c776f310d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.224475 Aug 31 09:50:15.520230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 230/467] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:15 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:16.246898 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:16.247839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.256884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.257940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.258622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.259586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.260130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.260637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.425246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.427989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:16.438755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e3c7ff12-1b0f-432b-ba7d-6b624830fddc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.197297 Aug 31 09:50:16.440201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 238/468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:16 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:16.542991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:16.544278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.552302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.552935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.553843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.554817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.555434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.556058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.713288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.727495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.728925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.730156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b6dea776-ae4a-41a2-a3cd-077a88b668c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.191122 Aug 31 09:50:16.745640 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 231/469] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:16 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:16.752579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa9522f3-a876-47ee-993e-8f1e4b9864b2"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:16.754915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.762380 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.762869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.763304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.764000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.764448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.764865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.187268 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5fb238ab-9560-48eb-b072-b648a671da5b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438866 Aug 31 09:50:17.188467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 239/470] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:50:16 2022] POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:17.461634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:17.462362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:17.479159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.479981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.480457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.481317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.481645 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.482572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.620061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.628410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-499b4112-e14e-4286-934d-8aa69e0d377c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.171151 Aug 31 09:50:17.641665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 232/471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:17 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:17.757664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:17.758306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:17.764717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.765242 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.765919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.766628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.767292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.767728 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.902078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.910370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.911824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.912982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-09b83ac8-c5d2-44ae-82da-fe5a5ce24868 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.161735 Aug 31 09:50:17.913596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 240/472] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:17 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:18.649712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:18.650453 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:18.652456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:18.659019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.659564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.660013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.660738 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.661222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.661657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.806142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:18.814739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8e7c6f2d-d525-4d2b-8e55-744d07690e12 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.169639 Aug 31 09:50:18.815512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 233/473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:18 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:18.937275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:18.938006 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:18.947315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.947805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.948235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.948922 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.949398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.949817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.115686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.125327 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.127252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.130786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a74384d6-ed04-4111-8890-49b2e768f322 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.198201 Aug 31 09:50:19.131613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 241/474] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:18 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:19.287889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:19.288375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:19.294745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.295287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.295805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.296909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.297564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.298048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.328215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d2d8c3d6-b594-4950-aa61-5759019077f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/ips" status: 200 len: 150 microversion: 2.1 time: 0.044205 Aug 31 09:50:19.329151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 234/475] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:50:19 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:19.839181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:19.839706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:19.846214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.846697 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.847126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.847808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.848255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.848673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.978660 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.986463 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3a41621c-e532-4781-a04e-acb228c3927c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.151782 Aug 31 09:50:19.987016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 242/476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:19 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:20.156638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:20.157218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:20.163554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.164574 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.165034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.165725 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.166181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.166607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.298154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:20.307096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:20.309337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:20.310411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-df1f7ba6-fb56-41d0-8518-a0f919678f16 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.157771 Aug 31 09:50:20.311582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 235/477] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:20 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:21.007180 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:21.007746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:21.014049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.014533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.014972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.015653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.016103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.016524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.162133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.170732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3648dabb-3af9-4c1e-933f-7ae8ba0618e6 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.167510 Aug 31 09:50:21.171301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 243/478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:21 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:21.343001 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:21.343721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:21.352196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.353375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.354201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.355116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.355742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.356263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.522259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.531508 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.533324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.534636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ff835bf4-936c-4ff9-8a63-492711922fb1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.196638 Aug 31 09:50:21.542919 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 236/479] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:21 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:21.876509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff04bc4-99a6-4157-8473-06a5ca972e4e"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:21.878999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:21.886610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.887131 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.887582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.888314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.888784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.889271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.192390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:22.193100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:22.199281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.199763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.200396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.201126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.201576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.202024 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.290861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5e379e35-5858-4e2d-a396-1728e8985551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418665 Aug 31 09:50:22.291780 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 244/480] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:50:21 2022] POST /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:22.417497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.425832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b3d89257-120a-4c43-8fc2-406d2e60091d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.237792 Aug 31 09:50:22.427861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 237/481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:22 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:22.559824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:22.560533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:22.570264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.571959 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.572411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.573180 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.573636 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.579530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.139113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.150984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.153752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.155839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1cdab320-f988-48e9-bb58-185fc406afa5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.599908 Aug 31 09:50:23.174285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 245/482] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:22 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:23.451490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:23.452856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:23.461291 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.462026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.462774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.463662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.464278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.464861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.613211 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.627078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0b66a67f-b993-413c-980a-f0c5e9496ce7 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.177279 Aug 31 09:50:23.628448 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 238/483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:23 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:24.181911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:24.182600 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:24.193744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.194536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.195209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.196021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.196768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.197491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.367825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.376631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.378126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.379465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-becba34e-e72e-47c0-bfe6-12f1b953352b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.202205 Aug 31 09:50:24.380030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 246/484] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:24 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:24.647634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:24.649651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:24.656638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.657463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.658983 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.660030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.660557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.661128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.817949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.826120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9e732338-8bac-4b10-a087-0d431fc67473 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.182413 Aug 31 09:50:24.826684 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 239/485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:24 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:25.403855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:25.404443 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:25.411687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.412176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.412607 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.413503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.414540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.415121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.625613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:25.635587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:25.637978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:25.639159 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f17c3d2f-2aac-4ff2-aa12-79fd73ab26bc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.239672 Aug 31 09:50:25.656361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 247/486] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:25 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:25.852998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:25.853819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:25.861436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.862299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.862860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.863961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.864747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.865402 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.030181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:26.038676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4dae899f-cffc-4ab4-8e76-5b86bdae9ac1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.194369 Aug 31 09:50:26.039333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 240/487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:25 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:26.323392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-a3b58703-73ee-4e27-9f56-2adda10c1f06 req-0fdd1ce8-1692-41a5-8b40-1a8e9127e449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a576c4-6c87-49fd-b00b-ea140c968c8a", "name": "network-vif-plugged", "status": "completed", "tag": "96048666-ee31-454b-8cf1-204196456392"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:26.342770 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a3b58703-73ee-4e27-9f56-2adda10c1f06 req-0fdd1ce8-1692-41a5-8b40-1a8e9127e449 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.344385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a3b58703-73ee-4e27-9f56-2adda10c1f06 req-0fdd1ce8-1692-41a5-8b40-1a8e9127e449 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.345486 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a3b58703-73ee-4e27-9f56-2adda10c1f06 req-0fdd1ce8-1692-41a5-8b40-1a8e9127e449 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.362931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-a3b58703-73ee-4e27-9f56-2adda10c1f06 req-0fdd1ce8-1692-41a5-8b40-1a8e9127e449 service nova] Creating event network-vif-plugged:96048666-ee31-454b-8cf1-204196456392 for instance 68a576c4-6c87-49fd-b00b-ea140c968c8a on hv-cinder-83754 Aug 31 09:50:26.369285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-a3b58703-73ee-4e27-9f56-2adda10c1f06 req-0fdd1ce8-1692-41a5-8b40-1a8e9127e449 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051691 Aug 31 09:50:26.370463 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 248/488] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:26.671871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:26.672487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:26.678956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.679679 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.680134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.680831 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.681323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.681908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.042351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-38e74b49-a7c8-423b-9f53-f3bdd8aea471 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:27.056157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38e74b49-a7c8-423b-9f53-f3bdd8aea471 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.056723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38e74b49-a7c8-423b-9f53-f3bdd8aea471 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.057389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38e74b49-a7c8-423b-9f53-f3bdd8aea471 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.127314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-38e74b49-a7c8-423b-9f53-f3bdd8aea471 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Going to try to stop instance {{(pid=132479) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 09:50:27.199238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.202988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-38e74b49-a7c8-423b-9f53-f3bdd8aea471 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action" status: 202 len: 0 microversion: 2.1 time: 0.166416 Aug 31 09:50:27.203593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 249/489] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:50:27 2022] POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:50:27.211183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.213593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.214775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:27.215182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e1afc9d2-7351-41ab-8c1f-a4e7b7b64140 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.547872 Aug 31 09:50:27.215915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 241/490] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:26 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:27.216536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:27.222599 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:27.223418 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:27.226076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.226854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.227668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.228859 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.229718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.230370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.232111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.232772 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.233257 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.234225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.234694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.235149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.387965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.392328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:27.398756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8e79fc59-2644-466a-b313-d0efa1c2c66d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.181361 Aug 31 09:50:27.404874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 242/491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:27 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:27.444348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.455445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e77020ac-23d3-4875-8069-7b31b82fd9b9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.248019 Aug 31 09:50:27.456445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 250/492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:27 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:28.239935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:28.240559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:28.246989 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.247851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.248459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.249381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.250023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.250616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.395627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.404919 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.406993 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.408324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ed640cd2-6a99-493f-a5d6-e3d3941c8c4e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.172743 Aug 31 09:50:28.409020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 243/493] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:28 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:28.424232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:28.425070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:28.433538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.434061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.434838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.435693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.436399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.437086 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.475803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:28.477234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:28.483674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.484254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.484784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.485587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.486124 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.486626 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.627562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.644280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-34fab00c-15b5-489d-8cf6-54505e12e05a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.172166 Aug 31 09:50:28.645357 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 244/494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:28 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:28.687566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.696711 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a509773a-7d56-491e-aaee-114c47057857 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.277203 Aug 31 09:50:28.706498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 251/495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:28 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:29.434233 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.435550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.442822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.443314 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.443751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.444457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.444933 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.445386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.584948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.595491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.597714 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.598899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5c87b421-7a7b-41dc-b783-28146b05aee5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.170195 Aug 31 09:50:29.599876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 245/496] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:29.665915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.667272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.674055 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.674834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.675353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.676061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.676533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.677056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.693937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:29.724277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.725233 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.737021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.741509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.742030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.742821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.743387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.743911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.865818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.877847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8d6959a3-4580-4ee8-9e46-7c0741528f90 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1264 microversion: 2.1 time: 0.215645 Aug 31 09:50:29.897005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 252/497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:29.932760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.941840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-11a87778-0c6e-43a9-a03c-c86bdbf88a40 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.226057 Aug 31 09:50:29.956125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 246/498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:30.622816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.623729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.630091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.630814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.631485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.633035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.633704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.634212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.772923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:30.781224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:30.782667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:30.783853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-391753c2-80ba-436c-ac3f-c283c4e5a3d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.164961 Aug 31 09:50:30.784407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 253/499] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:30.898635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.899864 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.908646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.909468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.909913 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.910888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.911573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.912054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.970507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.981097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.987573 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.988395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.989122 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.990058 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.990744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.992054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.100154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.109788 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b87dacfc-5525-4e9c-9ee6-6bba1b0658d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1451 microversion: 2.1 time: 0.215005 Aug 31 09:50:31.125915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 247/500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:31.132165 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:31.133096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:31.141179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.141370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.141955 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.142624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.143678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.144348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.145761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.152511 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b9a4fc0a-9f15-4739-9379-081aed415ef5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.187045 Aug 31 09:50:31.157581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 254/501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:31.299480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.308200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-73a4733e-5f3b-4e4b-a2e4-f8c9a887bf01 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1451 microversion: 2.1 time: 0.179825 Aug 31 09:50:31.309078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 248/502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:31 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:31.811565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:31.814105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:31.823229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.824395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.825407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.826905 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.827573 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.828313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.006767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.023798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.026453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.028080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d9123ed8-365e-4fad-a02a-8c73d31793ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.222486 Aug 31 09:50:32.044995 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 255/503] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:31 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:32.176872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:32.178664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:32.187028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.187646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.188161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.189026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.189606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.190346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.480551 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.492652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7b89ca1e-4b4c-4b0f-9fee-c71e5ac7bba7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.321576 Aug 31 09:50:32.508159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 249/504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:32 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:33.054687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:33.056087 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:33.064731 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.065836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.066641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.068281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.068935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.069679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.279669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.287880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.289844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.290987 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-22727c78-02c9-44cc-87e2-443f1ddd82a9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.241189 Aug 31 09:50:33.291539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 256/505] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:33 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:33.415557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-92a9bb2e-f07b-49e5-85ea-c85d992ce76c req-b978a17f-fbd4-4139-bad5-a04bb13f94b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a576c4-6c87-49fd-b00b-ea140c968c8a", "tag": "96048666-ee31-454b-8cf1-204196456392"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:33.425429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-92a9bb2e-f07b-49e5-85ea-c85d992ce76c req-b978a17f-fbd4-4139-bad5-a04bb13f94b3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.426233 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-92a9bb2e-f07b-49e5-85ea-c85d992ce76c req-b978a17f-fbd4-4139-bad5-a04bb13f94b3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.426747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-92a9bb2e-f07b-49e5-85ea-c85d992ce76c req-b978a17f-fbd4-4139-bad5-a04bb13f94b3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.437598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-92a9bb2e-f07b-49e5-85ea-c85d992ce76c req-b978a17f-fbd4-4139-bad5-a04bb13f94b3 service nova] Creating event network-changed:96048666-ee31-454b-8cf1-204196456392 for instance 68a576c4-6c87-49fd-b00b-ea140c968c8a on hv-cinder-83754 Aug 31 09:50:33.443326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-92a9bb2e-f07b-49e5-85ea-c85d992ce76c req-b978a17f-fbd4-4139-bad5-a04bb13f94b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032260 Aug 31 09:50:33.444002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 250/506] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:33.517436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:33.518165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:33.524605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.525169 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.525616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.526312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.526769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.527194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.743307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.752640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2248a54c-3087-4f2e-87b1-4cee999738f6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.239058 Aug 31 09:50:33.753262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 257/507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:33 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:34.318585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:34.319617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:34.326381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.326870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.327340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.328023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.328479 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.328922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.480454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.489606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.492095 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.493584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d6730e04-9cbd-41de-a144-28a1ebf63c3e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.181771 Aug 31 09:50:34.505244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 251/508] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:34 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:34.775211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:34.775736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:34.782244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.782727 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.783158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.783843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.784294 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.784715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.917586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.925661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-348c8cae-ffdd-4c4d-9347-c75c29bad1a4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.155005 Aug 31 09:50:34.926220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 258/509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:34 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:35.518480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:35.519094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:35.527029 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.527524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.528048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.528749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.529242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.529671 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.663675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.671762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.673269 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.674443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4648d20a-a8d0-4e0c-ac43-fa36733fa3e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.160264 Aug 31 09:50:35.675012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 252/510] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:35 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:35.948354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:35.949131 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:35.955549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.956114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.956556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.957305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.957754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.958221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.196099 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:36.205166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d8357946-5f93-4c52-8592-04193ebbdf89 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.261222 Aug 31 09:50:36.205850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 259/511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:35 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:36.698592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:36.699400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:36.707267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.707835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.708280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.709027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.709658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.710249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.854919 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:36.865132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:36.867263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:36.868591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e3f7d0d0-6409-42cd-a5d4-09487038ee0f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.174860 Aug 31 09:50:36.869310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 253/512] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:36 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:37.227545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:37.228151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:37.234597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.235078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.235512 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.236196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.236653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.237105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.365227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.373414 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-91667277-abdc-425e-a1cf-80321b705d43 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.150275 Aug 31 09:50:37.373982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 260/513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:37 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:37.495873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-430a599a-9d24-4186-8602-6ed10ffeacfe tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: .version_select at 0x7f0b52876dc0>, body: {"keypair": {"name": "tempest-keypair-523300437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrY0YYsE3YpX7oUYq4gQb5ZKnTWLhfRcmTEPWPwuO8oA6gd/GSXxRYF2v2wFfFi1tA7qUr5JazzTM3Uvt6d0dL6MMsK9HrXimY3KCGb2IkmqnTJXu9HOWaBAaS31MOb4A=="}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:37.517435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-430a599a-9d24-4186-8602-6ed10ffeacfe tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:37.521144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-430a599a-9d24-4186-8602-6ed10ffeacfe tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:37.556144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-430a599a-9d24-4186-8602-6ed10ffeacfe tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064026 Aug 31 09:50:37.556814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 254/514] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:50:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:37.891298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:37.891917 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:37.899057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.899629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.900112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.900843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.901932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.902371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.124882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:38.133488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:38.135000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:38.136226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-01d0f909-0237-4a0b-b194-4a482922c13a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.249471 Aug 31 09:50:38.149291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 261/515] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:37 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:38.395375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:38.395998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:38.402047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:38.402539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:38.402978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.403707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:38.404167 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:38.404593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.539515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:38.548346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-40f85b38-8a7c-41f8-a4f9-8396acfb3c37 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.157552 Aug 31 09:50:38.548916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 255/516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:38 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:38.906435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1843681274", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e"}], "security_groups": [{"name": "tempest-securitygroup--657170089"}], "key_name": "tempest-keypair-523300437", "user_data": "}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:39.007672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] validate_networks() for [('4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:50:39.162056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:39.162666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:39.168631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.169165 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.169631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.170322 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.170870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.171483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.302754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.311470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.313035 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.314324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ad4a675e-1ac5-4f84-b027-448b2ba69733 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.157060 Aug 31 09:50:39.314968 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 256/517] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:39 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:39.389810 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:50:39.390348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:50:39.390989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:50:39.391404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:50:39.391819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:50:39.400627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.401089 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.401526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.402259 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.402710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.403130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.420577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:39.424496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:39.436049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:50:39.438371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:50:39.486262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-dff20e87-f73d-43d8-9f10-4a1ffb93dc5d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584068 Aug 31 09:50:39.486904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 262/518] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:50:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:50:39.497991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-48a1be9a-abbf-422c-9c28-5933ed3257d1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:39.498599 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-48a1be9a-abbf-422c-9c28-5933ed3257d1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:39.551864 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-48a1be9a-abbf-422c-9c28-5933ed3257d1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.559256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-48a1be9a-abbf-422c-9c28-5933ed3257d1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1241 microversion: 2.1 time: 0.065030 Aug 31 09:50:39.559843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 257/519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:39 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:39.571517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:39.572131 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:39.579595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.580094 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.580532 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.581274 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.581732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.582160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.719746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.728431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-181454c3-d634-495d-972c-1bfa9c9942d5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.163034 Aug 31 09:50:39.729027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 263/520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:39 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:40.319969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-dea82ad5-318b-4bed-b4a4-b5bb714b7ab9 req-82172b60-c699-476d-a04d-ebc024a10335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "name": "network-vif-plugged", "status": "completed", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:40.331564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-dea82ad5-318b-4bed-b4a4-b5bb714b7ab9 req-82172b60-c699-476d-a04d-ebc024a10335 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.333657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-dea82ad5-318b-4bed-b4a4-b5bb714b7ab9 req-82172b60-c699-476d-a04d-ebc024a10335 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.334350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-dea82ad5-318b-4bed-b4a4-b5bb714b7ab9 req-82172b60-c699-476d-a04d-ebc024a10335 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.340204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.340898 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.347868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-dea82ad5-318b-4bed-b4a4-b5bb714b7ab9 req-82172b60-c699-476d-a04d-ebc024a10335 service nova] Creating event network-vif-plugged:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:50:40.348137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.348637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.349642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.350542 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.351005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.351868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.354683 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-dea82ad5-318b-4bed-b4a4-b5bb714b7ab9 req-82172b60-c699-476d-a04d-ebc024a10335 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039869 Aug 31 09:50:40.355280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 258/521] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:40.483593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.492339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.493824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.494976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ec80b500-53d3-4438-ab29-e53f3013f300 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.160138 Aug 31 09:50:40.495571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 264/522] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:40.581049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.581740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.587674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.588149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.588578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.589288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.589735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.590156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.651256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.658873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2e1b635d-dc1c-41ce-aacc-6a44f1a10257 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1293 microversion: 2.1 time: 0.082497 Aug 31 09:50:40.659426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 259/523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:40.749227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.749837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.751681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:40.756939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.757460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.757894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.758579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.759032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.759454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.885348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.893547 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3afcab0e-8f6f-4b93-8022-df9bdf64a723 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.148223 Aug 31 09:50:40.894113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 265/524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:41.517511 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:41.518113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:41.523924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.524401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.524869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.525581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.526030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.526447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.656814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:41.665502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:41.666943 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:41.668092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e44ebfae-28d1-4f72-86d1-6338f9fc4900 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.154496 Aug 31 09:50:41.668650 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 260/525] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:41 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:41.679748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:41.680576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:41.686964 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.687443 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.687871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.688582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.689058 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.689477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.755066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:41.763046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-98a6a5a0-9ce9-40a2-99ff-83f5acee37ec tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1299 microversion: 2.1 time: 0.087077 Aug 31 09:50:41.763632 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 266/526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:41 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:41.915218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:41.915822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:41.922200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.922689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.923122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.923821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.924275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.924698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.053060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.062298 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bd8b6928-0c8d-4e73-9ecc-8b29ca53ab41 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.151699 Aug 31 09:50:42.062880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 261/527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:41 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:42.692321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:42.693247 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:42.700518 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.701045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.701606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.702307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.702774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.703193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.783800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:42.784413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:42.791318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.791797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.792308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.793151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.793602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.794020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.902404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.910703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.912239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.913710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a73cbc7a-65f0-4c30-967f-9fab638fa01c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.227183 Aug 31 09:50:42.914342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 267/528] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:42 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:42.918766 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-c5823bdd-34f4-4d20-a2ef-25801bda2326 req-82d55d57-167c-4317-9f1f-10cb8a6a6519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30323acf-ca69-4a6a-b55e-2a9e538b59b3", "tag": "0278d133-95eb-4631-a12e-46fb13bb1eec"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:42.929262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c5823bdd-34f4-4d20-a2ef-25801bda2326 req-82d55d57-167c-4317-9f1f-10cb8a6a6519 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.929748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c5823bdd-34f4-4d20-a2ef-25801bda2326 req-82d55d57-167c-4317-9f1f-10cb8a6a6519 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.930178 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c5823bdd-34f4-4d20-a2ef-25801bda2326 req-82d55d57-167c-4317-9f1f-10cb8a6a6519 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.933229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.935604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:42.942554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6f78b19f-7d24-4dea-8221-0064e618f579 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.162672 Aug 31 09:50:42.943028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-c5823bdd-34f4-4d20-a2ef-25801bda2326 req-82d55d57-167c-4317-9f1f-10cb8a6a6519 service nova] Creating event network-changed:0278d133-95eb-4631-a12e-46fb13bb1eec for instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 on hv-cinder-83754 Aug 31 09:50:42.943266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 262/529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:42 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:42.958479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-c5823bdd-34f4-4d20-a2ef-25801bda2326 req-82d55d57-167c-4317-9f1f-10cb8a6a6519 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043001 Aug 31 09:50:42.959053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 268/530] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:43.085826 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:43.086786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:43.093846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.094342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.095170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.096307 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.096768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.097220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.228073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:43.236286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a67a9cc2-fc8e-4ca7-a6e8-f6e2a609b5f3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.155874 Aug 31 09:50:43.236849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 263/531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:43 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:43.938349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:43.939050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:43.945404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.945877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.946300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.946974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.947418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.947834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.963948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:43.964561 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:43.970836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.971327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.971763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.972465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.972923 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.973379 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:44.080328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.089255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.090704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.091875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d8a1ba7e-9403-49c7-a704-63ef7e89819f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.158269 Aug 31 09:50:44.092434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 269/532] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:43 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:44.102452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.110147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d79e0f92-5b0a-4106-810c-3641df56bf51 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.150480 Aug 31 09:50:44.110706 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 264/533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:43 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:44.257960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:44.258493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:44.264472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:44.264988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:44.265431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:44.266122 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:44.266582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:44.267010 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:44.282332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:44.395797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.404285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3bddcf3a-4dd6-4318-a482-76935ef3cda5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.150775 Aug 31 09:50:44.404853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 270/534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:44 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:45.114752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:45.115361 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:45.121731 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.122206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.122635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.123311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.123759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.124212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.130716 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:45.131826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:45.138140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.138627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.139069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.139764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.140224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.140643 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.259246 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.267353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.268778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.269954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f5ca6f28-f68b-4a4f-b1f5-811bff986974 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.159065 Aug 31 09:50:45.270511 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 265/535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:45 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:45.274835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.282597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-02e3161b-6be4-41d7-829e-ae7349d98eea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.155905 Aug 31 09:50:45.283242 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 271/536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:45 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:45.425885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:45.426414 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:45.433030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.433515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.433948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.434639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.435129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.435553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.564561 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.573743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8285bb81-988c-491d-b96f-7b478e4cc3b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.151765 Aug 31 09:50:45.574327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 266/537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:45 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:46.293752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.294363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.300772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.301445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.301880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.302570 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.303030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.303449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.303449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.303675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.310016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.310502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.310938 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.311633 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.312092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.312514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.434957 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.444674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.446270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.447475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f660e898-5173-4b42-be6f-6018f0f2e785 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.157563 Aug 31 09:50:46.447599 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.448041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 272/538] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:46.455525 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-473f2402-3078-4453-b4cd-0657ba004603 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.156311 Aug 31 09:50:46.456090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 267/539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:46.594579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.595181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.601682 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.602157 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.602583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.603255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.603708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.604117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.730078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.738513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a7c0c1e9-50d4-41d7-a64d-160c3ceb705a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.147626 Aug 31 09:50:46.738994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 273/540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:47.471084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:47.471702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:47.476177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:47.476790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:47.479308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:47.479795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:47.480256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.480995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:47.481808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:47.482354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.482635 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:47.483141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:47.483579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.484457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:47.484940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:47.485176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.618000 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:47.626047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:47.627804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:47.628971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f4d13942-0baa-44b9-8dc1-f112f2187ed2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.162095 Aug 31 09:50:47.629568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 268/541] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:47 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:47.659882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:47.667667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a1693a82-3460-484b-8299-a17ffc64c6b5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.195978 Aug 31 09:50:47.668177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 274/542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:47 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:47.759527 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:47.760129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:47.766449 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:47.767343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:47.768392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.769568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:47.770498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:47.771050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.906876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:47.915581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c19b7f50-f9d5-4a74-8c42-49d074d81799 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.159857 Aug 31 09:50:47.916155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 269/543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:47 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:48.652563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:48.653158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:48.659540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.660022 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.660453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.661167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.661624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.662047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.687869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:48.688611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:48.692252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:48.696429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.697163 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.697605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.698346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.698972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.699434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.798629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:48.807543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:48.808991 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:48.810153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6ff99cb3-f5eb-4553-9772-0d91678b9c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1744 microversion: 2.20 time: 0.161632 Aug 31 09:50:48.810934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 275/544] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:48 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:48.832771 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:48.840456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5ec1af50-e07a-4eb1-8a62-25ca97e3e7a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.156372 Aug 31 09:50:48.841036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 270/545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:48 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:48.937120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:48.937733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:48.944475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.944982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.945444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.946131 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.946586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.947011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.096707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:49.107282 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d704ad98-e95e-4204-ab90-26528133a2f8 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1722 microversion: 2.1 time: 0.173971 Aug 31 09:50:49.108023 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 276/546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:48 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:49.835452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:49.836580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:49.842776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:49.845904 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.846649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.847085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.847817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.848266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.848682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.861275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:49.862680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:49.871676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:49.872346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:49.874570 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.881522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.882203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.883093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.883546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.884151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.020767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.031791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.033613 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.035082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5d6c097a-8295-48c9-a585-5140200019d2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.204602 Aug 31 09:50:50.049353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 271/547] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:49 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:50.052441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.061279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-16230f4f-2560-479c-88f8-02a4c6e2d90e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.203921 Aug 31 09:50:50.062465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 277/548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:49 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:50.129467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:50.130358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:50.136936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.137447 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.137884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.138589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.139041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.139463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.499362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.510066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-230a903d-2096-4a40-befd-1e0a936f6ee0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1699 microversion: 2.1 time: 0.384337 Aug 31 09:50:50.511195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 272/549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:50 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1699 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:50.532032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-09d967a2-3eaa-4971-b9f2-9e349e295bfc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:50.539289 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09d967a2-3eaa-4971-b9f2-9e349e295bfc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.539786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09d967a2-3eaa-4971-b9f2-9e349e295bfc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.540223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09d967a2-3eaa-4971-b9f2-9e349e295bfc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.564720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-09d967a2-3eaa-4971-b9f2-9e349e295bfc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Going to try to start instance {{(pid=132479) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 09:50:50.612929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-09d967a2-3eaa-4971-b9f2-9e349e295bfc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action" status: 202 len: 0 microversion: 2.1 time: 0.085103 Aug 31 09:50:50.613564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 278/550] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:50:50 2022] POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:50:50.622646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:50.623474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:50.632674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.633793 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.634491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.635303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.636016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.636624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.803556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.815621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-99e9aac4-f73c-4a17-8f4f-c7b431252937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1708 microversion: 2.1 time: 0.196996 Aug 31 09:50:50.829708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 273/551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:50 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1708 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:50.959751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-70513449-a1af-4cf6-acc3-a5fd56918122 req-40edb166-6f54-4ea5-a302-c1e9d935388a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30323acf-ca69-4a6a-b55e-2a9e538b59b3", "name": "network-vif-plugged", "status": "completed", "tag": "0278d133-95eb-4631-a12e-46fb13bb1eec"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:50.979693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-70513449-a1af-4cf6-acc3-a5fd56918122 req-40edb166-6f54-4ea5-a302-c1e9d935388a service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.980408 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-70513449-a1af-4cf6-acc3-a5fd56918122 req-40edb166-6f54-4ea5-a302-c1e9d935388a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.981455 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-70513449-a1af-4cf6-acc3-a5fd56918122 req-40edb166-6f54-4ea5-a302-c1e9d935388a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.997804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-70513449-a1af-4cf6-acc3-a5fd56918122 req-40edb166-6f54-4ea5-a302-c1e9d935388a service nova] Creating event network-vif-plugged:0278d133-95eb-4631-a12e-46fb13bb1eec for instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 on hv-cinder-83754 Aug 31 09:50:51.004395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-70513449-a1af-4cf6-acc3-a5fd56918122 req-40edb166-6f54-4ea5-a302-c1e9d935388a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050975 Aug 31 09:50:51.005307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 279/552] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:51.059889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:51.060501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:51.076089 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:51.077525 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:51.079036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:51.080537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:51.081515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:51.082968 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:51.083499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:51.084235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:51.094001 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:51.097877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:51.099540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:51.100332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:51.100798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:51.101263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:51.327666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:51.337308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:51.340609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:51.342376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b96c3242-2090-44d9-aef8-0fafcb2e9735 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.286107 Aug 31 09:50:51.344040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 274/553] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:51 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:51.354432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:51.368733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-039c230b-0d56-4e41-91cd-c4afd318890c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.290007 Aug 31 09:50:51.381416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 280/554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:51 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:51.838870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:51.839593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:51.852915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:51.853435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:51.853873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:51.854570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:51.855456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:51.855456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.019156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.028330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b0833b57-157a-4a70-9511-4e01c5e18719 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1708 microversion: 2.1 time: 0.193463 Aug 31 09:50:52.029704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 275/555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:51 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1708 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:52.370074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:52.370637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.377197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.377692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.378135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.378834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.379289 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.379713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.390429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:52.391620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.399627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.400356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.401676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.402743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.403398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.404186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.521683 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.530970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.532660 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.534084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ba891c9d-ad8b-4676-a30a-dfe947d5142f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.168565 Aug 31 09:50:52.534940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 281/556] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:52 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:52.542808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.550519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a9da751e-e02b-4a09-9a75-d47ce21fb34e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.164140 Aug 31 09:50:52.551082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 276/557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:52 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:53.049801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:53.050415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:53.057090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.057661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.058113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.058857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.059371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.059836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.204120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:53.213104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f003fa4c-2ac5-48b0-b111-27edf23b41c6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1708 microversion: 2.1 time: 0.167159 Aug 31 09:50:53.213692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 282/558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:53 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:53.561303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:53.562886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:53.572193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:53.573069 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.573577 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.574038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:53.574173 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.574863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.575328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.575757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.581593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.582559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.583223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.584680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.585373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.585858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.747757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:53.751654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:53.762063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8aab90c1-954d-4a9f-8228-4c1219fa0bbc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1366 microversion: 2.1 time: 0.193730 Aug 31 09:50:53.762709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 283/559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:53 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:53.769701 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:53.771874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:53.773810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e89247b9-d9bd-4089-86ea-24a9156d1788 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.216422 Aug 31 09:50:53.774796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 277/560] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:53 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:54.234630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:54.235381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:54.241920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.242671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.242884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.243573 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.244029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.244460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.388396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.397939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-287a196f-84fd-4baa-b220-29c57f213dcc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1708 microversion: 2.1 time: 0.167183 Aug 31 09:50:54.398612 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 284/561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:54 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:54.784197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:54.784787 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:54.792155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.792647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.793120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.793824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.794286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.794709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.797466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:54.798685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:54.806087 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.808000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.808445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.809184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.809817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.810245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.952002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.952743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.961802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-25512131-c193-414f-861d-783dbcb21dcf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1556 microversion: 2.1 time: 0.181432 Aug 31 09:50:54.962098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.962424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 278/562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:54 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:54.974860 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.976054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-385567ac-06a5-4fa1-9791-379d874c726a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.182931 Aug 31 09:50:54.976751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 285/563] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:54 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:54.990620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:54.991113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:54.997733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.998276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.998738 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.999483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.000010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.000444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.015338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:55.081381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5b0fe898-8c0a-438b-ab4f-f3855680055d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095119 Aug 31 09:50:55.081993 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 279/564] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:50:54 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:55.425068 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:55.425784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:55.434644 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.435234 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.436920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.437749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.438290 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.438788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.614817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:55.617685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:55.626154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f3c5002b-a266-4a7d-bfbd-1a17981d06e6 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1712 microversion: 2.1 time: 0.207137 Aug 31 09:50:55.626850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 286/565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:55 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1712 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:55.999986 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:56.000536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:56.007211 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.008682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:56.010090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:56.010963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.011625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:56.012206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:56.223859 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-84336181-6b05-4e39-a060-58afc342b9ed req-fa596b3d-17ef-4334-9ba5-4bfb9832fe1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30323acf-ca69-4a6a-b55e-2a9e538b59b3", "tag": "0278d133-95eb-4631-a12e-46fb13bb1eec"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:56.242120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-84336181-6b05-4e39-a060-58afc342b9ed req-fa596b3d-17ef-4334-9ba5-4bfb9832fe1c service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.242608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-84336181-6b05-4e39-a060-58afc342b9ed req-fa596b3d-17ef-4334-9ba5-4bfb9832fe1c service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:56.246834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:56.261874 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-84336181-6b05-4e39-a060-58afc342b9ed req-fa596b3d-17ef-4334-9ba5-4bfb9832fe1c service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:56.266570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:56.267963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:56.269485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6d93402b-fba7-428c-810c-90baca36ca8a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.274470 Aug 31 09:50:56.289021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 280/566] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:55 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:56.293520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-84336181-6b05-4e39-a060-58afc342b9ed req-fa596b3d-17ef-4334-9ba5-4bfb9832fe1c service nova] Creating event network-changed:0278d133-95eb-4631-a12e-46fb13bb1eec for instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 on hv-cinder-83754 Aug 31 09:50:56.298872 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-84336181-6b05-4e39-a060-58afc342b9ed req-fa596b3d-17ef-4334-9ba5-4bfb9832fe1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078518 Aug 31 09:50:56.299776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 287/567] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:57.296032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:57.297375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:57.308992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:57.310425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:57.311089 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:57.312186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:57.312847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:57.313527 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:57.465273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:57.476263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:57.477803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:57.478988 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-95933b32-c4cf-4300-8332-dc2e9b4551ee tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.189132 Aug 31 09:50:57.479582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 281/568] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:57 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:58.503942 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:58.504641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:58.512122 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:58.512610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:58.513083 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:58.513797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:58.514253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:58.514687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:58.665490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:58.676422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:58.678881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:58.680118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c1744af1-95b8-483a-8bb7-005fa45d3c79 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.180625 Aug 31 09:50:58.680800 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 288/569] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:58 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:59.705000 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:59.705593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:59.712487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:59.712997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:59.713437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:59.714135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:59.714589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:59.715101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:59.860592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:59.870792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:59.872304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:59.873545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c359b21f-38fc-43b2-abdf-5a2b73aa8ca7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.173203 Aug 31 09:50:59.874412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 282/570] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:59 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:00.898604 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:00.899146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:00.905710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:00.906198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:00.906638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:00.907325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:00.907811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:00.908240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:01.040415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:01.050356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:01.051803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:01.052991 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-64c042a4-d0c3-4eb7-9357-b4da7c9f9dc3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1739 microversion: 2.20 time: 0.158875 Aug 31 09:51:01.053540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 289/571] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:00 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:51:02.075262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:02.075864 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:02.081945 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:02.082364 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:02.082789 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:02.084141 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:02.084593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:02.085043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:02.217764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:02.226030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:02.227469 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:02.228664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-908df528-34c6-4536-9293-3d47d8a0c78c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1721 microversion: 2.20 time: 0.157431 Aug 31 09:51:02.229286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 283/572] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:02 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:03.253260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:03.254071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:03.261385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:03.261866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:03.262299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:03.262985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:03.263437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:03.263856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:03.393170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:03.401192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:03.402630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:03.403774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-349765aa-f2a0-4382-aa3e-55875c5cdcef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1721 microversion: 2.20 time: 0.154662 Aug 31 09:51:03.404337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 290/573] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:03 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:04.427057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:04.428808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:04.434738 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.435231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.435669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.436361 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.436820 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.437277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.566599 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.574702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.576159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.577344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d111c85f-fd9b-467c-9ae9-5100cac598d7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1721 microversion: 2.20 time: 0.154301 Aug 31 09:51:04.577905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 284/574] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:04 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:04.850661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-83e82258-21a4-4fe9-ab7c-90f505c8e963 req-b7ff4f69-83a8-49ce-92bc-ecb6869805c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "name": "network-vif-unplugged", "status": "completed", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:04.860748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-83e82258-21a4-4fe9-ab7c-90f505c8e963 req-b7ff4f69-83a8-49ce-92bc-ecb6869805c8 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.861257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-83e82258-21a4-4fe9-ab7c-90f505c8e963 req-b7ff4f69-83a8-49ce-92bc-ecb6869805c8 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.861693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-83e82258-21a4-4fe9-ab7c-90f505c8e963 req-b7ff4f69-83a8-49ce-92bc-ecb6869805c8 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.875513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-83e82258-21a4-4fe9-ab7c-90f505c8e963 req-b7ff4f69-83a8-49ce-92bc-ecb6869805c8 service nova] Creating event network-vif-unplugged:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:51:04.881132 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-83e82258-21a4-4fe9-ab7c-90f505c8e963 req-b7ff4f69-83a8-49ce-92bc-ecb6869805c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034252 Aug 31 09:51:04.881719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 291/575] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:05.600417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:05.601046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:05.607571 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.607969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.608589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.609308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.609757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.610176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.738326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:05.747298 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:05.748746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:05.749927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b8652898-2e14-41d6-8433-bae82bd12cde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1724 microversion: 2.20 time: 0.153897 Aug 31 09:51:05.750615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 285/576] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:05 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:51:05.772769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cc25e90-3cc2-4a8d-9d36-771d3e4e839b"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:05.775165 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:05.781263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.781743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.782171 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.782846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.783290 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.783704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.071180 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c1d35757-e5b0-427d-834c-45a213b62de4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302883 Aug 31 09:51:06.071809 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 292/577] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Aug 31 09:51:05 2022] POST /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:51:06.196906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:06.197650 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:06.203488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.203972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.204516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.205441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.205924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.206344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.253194 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132478) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 09:51:06.319810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7b63a480-9af2-4978-af5e-d66800454f73 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/action" status: 202 len: 0 microversion: 2.20 time: 0.127250 Aug 31 09:51:06.320407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 286/578] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 31 09:51:06 2022] POST /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:51:06.329223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:06.329829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:06.336409 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.336900 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.337357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.338053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.338513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.338934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.476576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:06.485964 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:06.487518 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:06.488691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8ef48d3d-3ee7-4613-a998-36dc92f56b20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1750 microversion: 2.20 time: 0.163857 Aug 31 09:51:06.489483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 293/579] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:06 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:07.512567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:07.513279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:07.519347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:07.519829 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:07.520264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.520978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:07.521435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:07.521995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.650950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.659592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.661154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.662338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b5d93956-6387-44f3-816d-250149bf8b6f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1752 microversion: 2.20 time: 0.154313 Aug 31 09:51:07.662902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 287/580] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:07 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:08.685737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:08.686332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:08.693450 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.693941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.694444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.695136 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.695843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.696306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.836564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.845627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.847255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.848432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-40fc0832-ba54-4ff6-bab1-bcc66ce1e232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.166549 Aug 31 09:51:08.849273 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 294/581] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:08 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:09.870473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:09.871110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:09.877654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.878137 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.878767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.879466 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.880186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.880607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:10.011707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:10.020213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:10.022204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:10.023364 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6710c139-7596-4b54-90d3-6f34cde2513d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.156799 Aug 31 09:51:10.023931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 288/582] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:09 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:11.046217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:11.046847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:11.049893 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=60 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:11.055786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:11.056279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:11.056718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.057483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:11.057943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:11.058523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.192743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:11.202058 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:11.203642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:11.204925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-63d7f820-d282-4e11-b2a0-aebf040f03fc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.162632 Aug 31 09:51:11.205506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 295/583] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:11 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:12.228109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:12.228721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:12.235097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.235581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.236016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.236707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.237200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.237629 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.369133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:12.378712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:12.380185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:12.381394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ef2192b9-4b0b-44bd-b9ca-2edcd0526995 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.157187 Aug 31 09:51:12.381971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 289/584] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:12 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:13.404846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:13.405588 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:13.413567 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.414104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.414710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.415412 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.415870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.416290 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.552940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:13.561573 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:13.562997 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:13.564139 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b6841dd7-b097-41c4-a1f9-04db2dd0cb49 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.163286 Aug 31 09:51:13.564936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 296/585] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:13 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:14.587285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:14.587893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:14.594312 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.594792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.595252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.595940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.596391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.596813 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.730871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:14.739344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:14.740788 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:14.741977 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eaf0d4ee-527d-4c9e-a2f7-fa9c9ebe0d38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.159160 Aug 31 09:51:14.742536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 290/586] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:14 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:15.765854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:15.766472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:15.773997 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.774494 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.774935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:15.775640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.776091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.776513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:15.909850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:15.919423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:15.920873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:15.922065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-beab981f-dfd6-4ec9-84d2-1e083cb45aa2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.160150 Aug 31 09:51:15.922623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 297/587] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:15 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:16.945873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:16.946475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:16.953192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.953682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.954118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.954823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.955282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.955708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.092299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:17.101610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:17.103063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:17.104224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e19818d1-3b95-410b-8307-9091c202cf94 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.162220 Aug 31 09:51:17.104786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 291/588] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:16 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:18.127773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:18.128388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:18.135520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.136014 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.136453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.137193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.137650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.138074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.271281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:18.279856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:18.281309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:18.282447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4eab9969-5ef0-4fc9-948a-aa5ef236416e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.158594 Aug 31 09:51:18.282993 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 298/589] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:18 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:19.305539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:19.306180 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:19.308715 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:19.315303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:19.315786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:19.316597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:19.318262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:19.318721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:19.319146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:19.454308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:19.464741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:19.466252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:19.467427 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3075c422-f364-4c59-8c02-c994d014dee7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.166149 Aug 31 09:51:19.468137 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 292/590] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:19 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:20.490655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:20.491275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:20.497719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:20.498209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:20.498648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.499340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:20.499805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:20.500232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.639694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:20.649032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:20.650664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:20.651829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b913c193-9d04-4c0d-bd75-097d576bd2e8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.165218 Aug 31 09:51:20.652405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 299/591] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:20 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:21.675036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:21.675664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:21.683845 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.684344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.684785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.685523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.685983 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.686415 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.826254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:21.835369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:21.836820 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:21.843281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-addb8a7d-9c87-4697-8ea9-5dfe53384812 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.168565 Aug 31 09:51:21.843281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 293/592] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:21 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:22.867415 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:22.868143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:22.875143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:22.875650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:22.876145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:22.876798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:22.877285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:22.877708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.075871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:23.084818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:23.086780 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:23.088017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-eb137efa-e6cf-4c0c-861c-e8f598db5f06 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.225143 Aug 31 09:51:23.092474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 300/593] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:22 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:24.111785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:24.112392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:24.119277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:24.119762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:24.120197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:24.120884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:24.121363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:24.121788 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:24.247871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:24.256858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:24.258331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:24.259487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2cd6e500-d8d6-4c14-953f-39127df41ff8 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.151626 Aug 31 09:51:24.260044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 294/594] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:24 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:25.282093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:25.282702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:25.289827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.290321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.290756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.291445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.291903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.292330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.422924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:25.431968 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:25.433433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:25.434571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-52b38d74-bcb2-43a1-a3ff-70accc6acf2d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.156388 Aug 31 09:51:25.435119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 301/595] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:25 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:26.457289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:26.457866 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:26.464207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:26.464689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:26.465155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:26.465837 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:26.466292 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:26.466715 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:26.469249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:26.641696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:26.650667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:26.652101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:26.653367 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-526214fa-997d-4ae2-aef4-1afbbc5c77ab tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.199910 Aug 31 09:51:26.653929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 295/596] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:26 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:27.675971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:27.676642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:27.683341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.683825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.684262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.684951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.685435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.685862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.690045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:27.818161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:27.826818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:27.828344 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:27.829550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a2a426bf-3c53-4fd1-9120-dca46507b47a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.157490 Aug 31 09:51:27.830091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 302/597] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:27 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:28.854340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:28.854947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:28.861310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:28.861799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:28.862239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:28.862927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:28.863475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:28.863891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:28.994608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:29.003531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:29.005539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:29.006695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d4ddef7b-aa26-4dee-8a43-208b4ed0bc91 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.156282 Aug 31 09:51:29.007261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 296/598] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:28 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:30.030372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:30.030991 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:30.038009 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:30.038501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:30.038940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:30.039632 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:30.040093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:30.040517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:30.414925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:30.423711 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:30.425176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:30.426317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9a2beb7e-4b5a-4e0a-92cf-c0087aa87c38 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.399840 Aug 31 09:51:30.426873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 303/599] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:30 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:31.548425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:31.549057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:31.554851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:31.555327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:31.555768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:31.556429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:31.556873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:31.557317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:31.682858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:31.691471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:31.693002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:31.694143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8a7e37f4-193f-4d4d-9e40-a67b53259ae6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.248179 Aug 31 09:51:31.694700 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 297/600] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:31 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:32.717526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:32.718118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:32.725418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:32.725969 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:32.726401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:32.727349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:32.727802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:32.728224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:32.854770 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:32.863861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:32.865329 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:32.866483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9a7a8f5e-72ce-4843-91c4-e22bdc6009c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.152817 Aug 31 09:51:32.867044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 304/601] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:32 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:33.888638 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:33.889279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:33.895787 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:33.896274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:33.896708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:33.897442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:33.897900 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:33.898320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:34.030479 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:34.038876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:34.040291 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:34.041464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d5199ca0-e239-42ee-8b36-00d25490aa26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.156659 Aug 31 09:51:34.042024 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 298/602] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:33 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:35.065503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:35.066669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:35.073338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:35.073833 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:35.074271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:35.074970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:35.075425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:35.075852 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:35.206554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:35.216059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:35.217515 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:35.218677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f0517c88-5daf-4113-8095-7db82ce138bf tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.157424 Aug 31 09:51:35.219227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 305/603] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:35 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:36.241490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:36.242099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:36.248401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:36.248879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:36.249341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:36.250028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:36.250480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:36.250903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:36.377253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:36.386230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:36.387675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:36.388836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7d31cdba-b3fe-4532-87f0-625072918b19 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.151282 Aug 31 09:51:36.389430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 299/604] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:36 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:37.412754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:37.413338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:37.419719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:37.420209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:37.420654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:37.421376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:37.421835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:37.422265 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:37.551417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:37.560110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:37.561560 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:37.562742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-efd2f336-f9e0-4a9c-bf7a-b0fade094a65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.154534 Aug 31 09:51:37.563300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 306/605] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:37 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:38.585190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:38.585794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:38.592268 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:38.592752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:38.593227 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:38.593930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:38.594388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:38.594814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:38.732436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.741660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.743102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.744259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e03cc90d-0a8e-404d-b74d-797d1661a3e6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.163078 Aug 31 09:51:38.744819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 300/606] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:38 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:39.064676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-ca133ab9-4ce6-4385-af3c-567d3022fabb req-e6bb388d-b18b-4faf-acb7-5f983657ec35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "name": "network-vif-plugged", "status": "completed", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:39.077630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ca133ab9-4ce6-4385-af3c-567d3022fabb req-e6bb388d-b18b-4faf-acb7-5f983657ec35 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.078109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ca133ab9-4ce6-4385-af3c-567d3022fabb req-e6bb388d-b18b-4faf-acb7-5f983657ec35 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.078539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ca133ab9-4ce6-4385-af3c-567d3022fabb req-e6bb388d-b18b-4faf-acb7-5f983657ec35 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.092174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-ca133ab9-4ce6-4385-af3c-567d3022fabb req-e6bb388d-b18b-4faf-acb7-5f983657ec35 service nova] Creating event network-vif-plugged:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:51:39.097863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-ca133ab9-4ce6-4385-af3c-567d3022fabb req-e6bb388d-b18b-4faf-acb7-5f983657ec35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036545 Aug 31 09:51:39.098584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 307/607] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:39.766990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:39.767602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:39.773987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.774482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.774921 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.775619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.776076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.776502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.907745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.916244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.917721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.918871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-70a8fbd6-1e2e-43f8-b1a8-cc8339e9257f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.155867 Aug 31 09:51:39.919427 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 301/608] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:39 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:40.942949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:40.943646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:40.950236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:40.950725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:40.951162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:40.951854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:40.952312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:40.952741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:41.080557 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:41.089880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:41.091038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:41.092266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-15d44d68-ad5a-4ffd-8b27-792ec3b7c4fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.153806 Aug 31 09:51:41.092855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 308/609] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:40 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:42.115371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:42.116078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:42.122803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:42.123380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:42.123895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:42.124592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:42.125074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:42.125506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:42.258647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:42.267289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:42.269361 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:42.270540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-78b08c8f-2fe7-4f25-87b8-e1976ff6e4ed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1808 microversion: 2.20 time: 0.159604 Aug 31 09:51:42.271127 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 302/610] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:42 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:43.293788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:43.294399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:43.296789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=28 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:43.302776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:43.303283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:43.303855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:43.304541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:43.305015 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:43.305435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:43.434750 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.443564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.445017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.446166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d4a9cb18-1f9d-429c-bf16-055782754de6 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1795 microversion: 2.20 time: 0.156272 Aug 31 09:51:43.446717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 309/611] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:43 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1795 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:46.731134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64691545-8266-4754-838e-6e5dec134f13"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:46.733621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:46.739444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:46.739919 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:46.740346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:46.741051 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:46.741503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:46.741922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:47.030764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a3ac0837-c027-42f4-833a-a468c75b7c62 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402650 Aug 31 09:51:47.031368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 303/612] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:51:46 2022] POST /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:55.598510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:55.600748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:55.603155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:55.603818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=43 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:55.609964 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.610450 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.610889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.611576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.612095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.612522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.636689 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lazy-loading 'flavor' on Instance uuid 0150f767-f03e-4999-aaba-5ef9d302fa94 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:51:55.757605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ff7e6356-187a-4198-91e5-1acb67c23046 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/action" status: 200 len: 32 microversion: 2.1 time: 0.163370 Aug 31 09:51:55.758116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 310/613] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:51:55 2022] POST /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:51:55.769776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:55.770496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:55.772529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=24 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:55.777973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.778457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.778885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.779575 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.780088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.780504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.916632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:55.924842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-98abe863-2f26-482a-83b0-e9666e48ea85 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.160833 Aug 31 09:51:55.925439 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 304/614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:55 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:56.946881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:56.947580 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:56.953689 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:56.954173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:56.954608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:56.955294 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:56.956237 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:56.956659 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:57.086723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:57.095111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-09c5e9df-d367-43a8-986c-18b2bfdfc38f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.152875 Aug 31 09:51:57.095667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 311/615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:56 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:58.116408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:58.116940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:58.123255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:58.123739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:58.124165 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:58.124843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:58.125320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:58.125739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:58.131394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:58.257590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:58.265698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b4256e06-bbb3-42a4-adaa-24b4df47ef09 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.153942 Aug 31 09:51:58.266266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 305/616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:58 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:59.288204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:59.289364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:59.297620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:59.298054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:59.298491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:59.300492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:59.300936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:59.301396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:59.435366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:59.443748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-aad61508-25a7-42ee-8798-6af9f95de9d6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.160796 Aug 31 09:51:59.444309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 312/617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:59 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:00.465823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:00.466421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:00.473249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:00.473729 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:00.474161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:00.474846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:00.475300 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:00.475719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:00.604806 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:00.613497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-009f680a-a3d2-4eab-bab1-eb2dbcc23c94 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.151547 Aug 31 09:52:00.614066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 306/618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:00 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:01.634675 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:01.635287 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:01.641693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.642177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.642610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.643459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.643914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.644339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.776473 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:01.784791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0e516f8d-ec9e-4baa-9f1e-7bbffe8432bc tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.153990 Aug 31 09:52:01.785598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 313/619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:01 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:02.806200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:02.806804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:02.813098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:02.813865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:02.814276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:02.815460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:02.815913 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:02.816333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:02.942049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:02.950032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3e6da0c9-db8c-4b32-921d-8cf5c1af3309 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.147693 Aug 31 09:52:02.950596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 307/620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:02 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:03.971654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:03.972262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:03.978647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.979137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.979574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.980269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.980729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.981189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:04.107241 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:04.115363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-68a53420-80fb-4093-acf1-8f3a20610561 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.148130 Aug 31 09:52:04.115925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 314/621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:03 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:05.137016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:05.137633 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:05.144725 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.145242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.145682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.146373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.146835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.147259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.273336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:05.281450 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-baa61654-2d90-4341-b10d-b4b96863eead tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.148307 Aug 31 09:52:05.282018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 308/622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:05 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:06.301950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:06.302565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:06.309137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.309623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.310059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.310744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.311201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.311624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.443998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:06.452232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-65d04d8f-d94a-4933-883e-ee556e266923 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.154197 Aug 31 09:52:06.452797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 315/623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:06 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:07.474287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:07.474899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:07.481579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:07.482137 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:07.482578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:07.483268 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:07.483723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:07.484147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:07.612579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:07.620616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7a936ad3-fd4d-4a80-b164-64fa80ea4db8 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.150808 Aug 31 09:52:07.621215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 309/624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:07 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:08.641861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:08.642480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:08.648887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.649404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.649844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.650535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.650994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.651418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.779910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:08.788574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b5d2c618-8cec-4e64-b442-8e679f7685d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.150587 Aug 31 09:52:08.789175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 316/625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:08 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:09.810623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:09.811220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:09.818472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.818956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.819396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.820084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.820539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.820985 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.947802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:09.956054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ca3820c6-324e-40ef-bee1-d5ad5640de87 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.149738 Aug 31 09:52:09.956631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 310/626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:09 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:10.976911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:10.977548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:10.983921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:10.984406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:10.984839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:10.985601 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:10.986053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:10.986474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:11.114330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:11.122497 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2471e76c-d3c4-48da-9837-caac7b8095d4 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1735 microversion: 2.1 time: 0.149460 Aug 31 09:52:11.123067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 317/627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:10 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:12.144053 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.144662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.151026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.151507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.151946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.152631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.153116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.153543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.292614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.300712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-893e262a-8c87-4c3b-9069-b1ad146a40da tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1715 microversion: 2.1 time: 0.161031 Aug 31 09:52:12.301333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 311/628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:12 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:12.360631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.361223 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.367672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.368156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.368590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.369311 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.369768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.370197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.492495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] HTTP exception thrown: Cannot 'detach_volume' instance 0150f767-f03e-4999-aaba-5ef9d302fa94 while it is in vm_state rescued Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Request method failure captured: Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments/64691545-8266-4754-838e-6e5dec134f13 HTTP/1.1 Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy38rhyCWbhrWtX4ZXPzZ8Svs_WJ0Ldq5jcu2O8coUQH-O-yM9_WeD23tE_uxwq-ZWZox_aBUTiH8Zqr5L57Exj0BpSGO-n4ysILMuW_bASeu2tUuEPRhY8FYvcPyz2tpUQ_eNzXwkJokzuCOEJ8VBvnoGfwLJdX9b2Bb9npRJqqkaI Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:52:12.494506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089a845bce2542969b7e6f013b28d928"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089a845bce2542969b7e6f013b28d928", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 79acdbc2c11c4459928eab5b83a6755d Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:52:12.496044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Cannot 'detach_volume' instance 0150f767-f03e-4999-aaba-5ef9d302fa94 while it is in vm_state rescued Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'server_id': '0150f767-f03e-4999-aaba-5ef9d302fa94', 'id': '64691545-8266-4754-838e-6e5dec134f13'} Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:12.496850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0150f767-f03e-4999-aaba-5ef9d302fa94 while it is in vm_state rescued Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0150f767-f03e-4999-aaba-5ef9d302fa94 while it is in vm_state rescued Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:12.498147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Returning 409 to user: Cannot 'detach_volume' instance 0150f767-f03e-4999-aaba-5ef9d302fa94 while it is in vm_state rescued {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:12.499146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-02c22b91-bcea-4dae-a81f-32fe138d0b6e tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments/64691545-8266-4754-838e-6e5dec134f13" status: 409 len: 152 microversion: 2.1 time: 0.139232 Aug 31 09:52:12.499146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 318/629] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:52:12 2022] DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments/64691545-8266-4754-838e-6e5dec134f13 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:52:12.505306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:12.505870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.511694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.512178 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.512612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.513334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.513789 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.514210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.578176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a355ad6d-b1f5-4396-805c-107486b86f14 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "POST /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/action" status: 202 len: 0 microversion: 2.1 time: 0.077071 Aug 31 09:52:12.578795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 312/630] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:12 2022] POST /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:52:12.587787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.589144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.595362 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.595793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.596372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.597311 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.597786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.598385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.803500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.811692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-34b2f993-ee60-440c-b496-03caf4a2ec03 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1723 microversion: 2.1 time: 0.227979 Aug 31 09:52:12.812342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 319/631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:12 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:13.834267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:13.834965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:13.841051 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.841539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.841975 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.842666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.843122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.843546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.969960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.978588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-03c2a980-50a1-4476-93f5-2a47b5894249 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1723 microversion: 2.1 time: 0.149019 Aug 31 09:52:13.979157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 313/632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:13 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:15.000069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:15.000680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:15.007783 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.008269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.008706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.009425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.009882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.010313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.139474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:15.147541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-bb698107-5291-40fa-8a96-c2626aafc3e1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1723 microversion: 2.1 time: 0.151311 Aug 31 09:52:15.148102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 320/633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:14 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:15.789452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:15.790018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:15.795828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.796316 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.796757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.797474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.797938 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.798872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.927303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lazy-loading 'services' on Instance uuid 1e0d2303-37de-40e0-b537-804a86067dee {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:16.045527 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e38e281a-5dee-41b4-8d19-6f27ed604ff7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-volume_attachments/aa9522f3-a876-47ee-993e-8f1e4b9864b2" status: 202 len: 0 microversion: 2.1 time: 0.356730 Aug 31 09:52:16.046155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 314/634] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:52:15 2022] DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-volume_attachments/aa9522f3-a876-47ee-993e-8f1e4b9864b2 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:16.167446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:16.168052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:16.174728 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:16.175848 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:16.176286 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.177035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:16.177488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:16.177910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.322108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.330970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-57a7d624-096d-4c70-955b-8bcdab181a80 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1723 microversion: 2.1 time: 0.167397 Aug 31 09:52:16.331540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 321/635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:16 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:17.353315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.353924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:17.359934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.360421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.360850 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.361559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.362009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.362428 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.498560 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.506981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e3df6cc3-98b1-4820-a0c0-e8ec0cb51743 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1729 microversion: 2.1 time: 0.158504 Aug 31 09:52:17.507550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 315/636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:17.527925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.528452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:17.534956 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.535444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.535882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.536577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.537132 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.537563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.619173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f5c4fb3b-0fcf-4232-9a48-4d4f079c59e3 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095311 Aug 31 09:52:17.619798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 322/637] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:18.220059 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6bd186ce-6595-4de7-a853-dadf43754af7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:18.226276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6bd186ce-6595-4de7-a853-dadf43754af7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.226763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6bd186ce-6595-4de7-a853-dadf43754af7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.227202 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6bd186ce-6595-4de7-a853-dadf43754af7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.288872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6bd186ce-6595-4de7-a853-dadf43754af7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Going to try to stop instance {{(pid=132478) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 09:52:18.336900 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6bd186ce-6595-4de7-a853-dadf43754af7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action" status: 202 len: 0 microversion: 2.1 time: 0.119669 Aug 31 09:52:18.337569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 316/638] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:18 2022] POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:18.348326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:18.349140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.356932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.357474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.358336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.358638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.359102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.359543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.593170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.603787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-707693ce-ae1b-4815-a08a-b99334e76db2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.261804 Aug 31 09:52:18.605752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 323/639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:18 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:18.649293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-ba6557c8-df90-48db-b0a1-959ab143dabb req-b4e6f7ca-6ba4-4884-9040-3fef608868b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0150f767-f03e-4999-aaba-5ef9d302fa94", "tag": "d542308a-b45c-47b1-8483-16192cde0e91"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:18.659208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ba6557c8-df90-48db-b0a1-959ab143dabb req-b4e6f7ca-6ba4-4884-9040-3fef608868b3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.659685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ba6557c8-df90-48db-b0a1-959ab143dabb req-b4e6f7ca-6ba4-4884-9040-3fef608868b3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.660106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ba6557c8-df90-48db-b0a1-959ab143dabb req-b4e6f7ca-6ba4-4884-9040-3fef608868b3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.670648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-ba6557c8-df90-48db-b0a1-959ab143dabb req-b4e6f7ca-6ba4-4884-9040-3fef608868b3 service nova] Creating event network-changed:d542308a-b45c-47b1-8483-16192cde0e91 for instance 0150f767-f03e-4999-aaba-5ef9d302fa94 on hv-cinder-83754 Aug 31 09:52:18.675962 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-ba6557c8-df90-48db-b0a1-959ab143dabb req-b4e6f7ca-6ba4-4884-9040-3fef608868b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095025 Aug 31 09:52:18.676602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 317/640] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:19.629214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:19.629758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:19.636200 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.636686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.637154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.637845 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.638300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.638725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.770654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:19.774245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:19.779019 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-398530f9-d02b-4641-8a48-1242c9545acc tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.153904 Aug 31 09:52:19.779581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 324/641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:19 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:20.691121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-37221822-f682-4029-8898-c08ab09fd1cf req-383a2401-f49b-4a1e-b1ff-1f0cb1eba20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0150f767-f03e-4999-aaba-5ef9d302fa94", "tag": "d542308a-b45c-47b1-8483-16192cde0e91"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:20.700310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-37221822-f682-4029-8898-c08ab09fd1cf req-383a2401-f49b-4a1e-b1ff-1f0cb1eba20b service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.700776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-37221822-f682-4029-8898-c08ab09fd1cf req-383a2401-f49b-4a1e-b1ff-1f0cb1eba20b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.701247 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-37221822-f682-4029-8898-c08ab09fd1cf req-383a2401-f49b-4a1e-b1ff-1f0cb1eba20b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.711746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-37221822-f682-4029-8898-c08ab09fd1cf req-383a2401-f49b-4a1e-b1ff-1f0cb1eba20b service nova] Creating event network-changed:d542308a-b45c-47b1-8483-16192cde0e91 for instance 0150f767-f03e-4999-aaba-5ef9d302fa94 on hv-cinder-83754 Aug 31 09:52:20.716499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-37221822-f682-4029-8898-c08ab09fd1cf req-383a2401-f49b-4a1e-b1ff-1f0cb1eba20b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030133 Aug 31 09:52:20.717164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 318/642] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:20.800771 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:20.801407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:20.808091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.808577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.809073 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.809764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.810217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.810638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.273586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:21.281394 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b28dcc7b-054a-435a-b357-59d58994bf59 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.485578 Aug 31 09:52:21.285613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 325/643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:20 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:22.303767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:22.304458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:22.310509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.310996 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.311433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.312126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.312583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.313283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.448764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.456983 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c6821ced-14c2-4444-bfaf-ca62acb37266 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.157851 Aug 31 09:52:22.457547 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 319/644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:22 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:23.477814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:23.478433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:23.484873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.485400 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.485838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.486536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.486992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.487418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.618014 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:23.625683 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-af372fbe-8be4-41bc-90b5-052ff3363e5f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.151748 Aug 31 09:52:23.626760 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 326/645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:23 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:24.647900 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:24.648536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:24.654935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:24.655417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:24.655852 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.656536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:24.657015 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:24.657487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.674742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:24.787199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:24.794765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-86d50b5d-9674-4069-8d92-a27648ebc9c3 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.150721 Aug 31 09:52:24.795333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 320/646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:24 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:25.816338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.816972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.819382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=35 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:25.824480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.824985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.825427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.826121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.826581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.827005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.027904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.036015 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c5eafe57-6d0e-4dfe-ac81-21897323b2ed tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.224294 Aug 31 09:52:26.036598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 327/647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:25 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:27.057348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.057948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.060196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=34 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:27.066494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.066969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.067398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.068082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.068530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.068974 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.203573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.211972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8b361d62-6fc4-4ec2-b05f-81731dd52399 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.158353 Aug 31 09:52:27.212522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 321/648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:28.232781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.233463 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.240041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.240529 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.240981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.241679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.242137 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.242561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.375396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:28.383950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e01b2ed9-b94f-45f2-8221-dfc778c3822d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.154984 Aug 31 09:52:28.384522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 328/649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:29.405226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:29.405785 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:29.412778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.413294 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.413727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.414410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.414861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.415282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.540293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:29.547885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dc4eaf37-2f4d-4884-bb92-57c907649782 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.146705 Aug 31 09:52:29.548474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 322/650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:29 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:30.569378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.569985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.576326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.576807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.577275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.577960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.578408 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.579461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.707272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.715002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-54fb2c26-2ad2-4179-9470-f05119ae97b5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.149447 Aug 31 09:52:30.715565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 329/651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:31.736979 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:31.737591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:31.743550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.744025 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.744452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.745236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.745687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.746102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.875813 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.883373 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1dbf19b5-45b5-417a-b47c-afa6efceb652 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.151212 Aug 31 09:52:31.883935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 323/652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:31 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:32.903992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.904618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.911049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.911536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.911973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.912677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.913192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.913617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.043908 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.052163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4057a09b-31d6-4566-b455-a8fb5055548d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.152032 Aug 31 09:52:33.052738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 330/653] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:34.073960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:34.074599 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:34.081113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.081602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.082041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.082736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.083201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.083632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.208123 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.215740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-015b4ae4-6bb5-4d86-9706-dd1d05780fab tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.145676 Aug 31 09:52:34.216334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 324/654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:34 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:35.238145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:35.238753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:35.245256 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.245748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.246184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.246872 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.247328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.247751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.374530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.382778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-50d45db8-d92a-4361-baae-83d0f39a8a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.149039 Aug 31 09:52:35.383375 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 331/655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:35 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:36.403604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:36.404209 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:36.410585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.411067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.411530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.412214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.412669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.413133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.541105 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.550224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9f1ef1bb-ead2-4b4f-a94b-c827a64423f9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.150434 Aug 31 09:52:36.550798 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 325/656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:36 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:37.571629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:37.572246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:37.579235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.579722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.580152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.580837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.581326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.581751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.709129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.717229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-672f9a31-bd12-44aa-a210-bafbfa82201f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.149380 Aug 31 09:52:37.717794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 332/657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:37 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:38.742460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:38.743068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:38.749582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.750654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.750983 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.751662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.752113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.752529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.888404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.896134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bba93544-90a1-47bc-bb1a-d5fca4bda880 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1676 microversion: 2.1 time: 0.157489 Aug 31 09:52:38.896699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 326/658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:38 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:39.917513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:39.918114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:39.925192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.925673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.926119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.926795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.927240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.927657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.056862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:40.065270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5d967b85-a9b3-472f-8869-ed879e5465ff tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1653 microversion: 2.1 time: 0.151573 Aug 31 09:52:40.065828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 333/659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:39 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:40.085341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-99e0d282-673e-45a2-8b8f-3de6375aea9f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:40.091836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e0d282-673e-45a2-8b8f-3de6375aea9f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.092330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e0d282-673e-45a2-8b8f-3de6375aea9f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.092766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99e0d282-673e-45a2-8b8f-3de6375aea9f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.115721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-99e0d282-673e-45a2-8b8f-3de6375aea9f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Going to try to start instance {{(pid=132478) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 09:52:40.155504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-99e0d282-673e-45a2-8b8f-3de6375aea9f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action" status: 202 len: 0 microversion: 2.1 time: 0.073790 Aug 31 09:52:40.156038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 327/660] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:40 2022] POST /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:40.165526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:40.166147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:40.173287 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.173955 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.174437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.175143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.176197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.176719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.332044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:40.339851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ca19998e-0cbf-4ec4-a09a-4de68a5451d1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1662 microversion: 2.1 time: 0.178111 Aug 31 09:52:40.340425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 334/661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:40 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:41.362704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:41.363382 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:41.369546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.370033 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.370475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.371167 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.371624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.372076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.504396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.512288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-db663ee3-0d42-411e-813e-45687eec54af tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1662 microversion: 2.1 time: 0.154915 Aug 31 09:52:41.512883 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 328/662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:41 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:42.534158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.534769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.541584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.542069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.542505 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.543188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.543640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.544062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.676080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.683738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-00343808-5e46-4856-a737-caf4df8d0fbd tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1666 microversion: 2.1 time: 0.154004 Aug 31 09:52:42.684306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 335/663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:45.894569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:45.895056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:45.900841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:45.901350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:45.901778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:45.902455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:45.902902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:45.903318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:45.926717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5c20886e-a5fa-4497-a5d1-e398f5cbc4be tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/ips" status: 200 len: 150 microversion: 2.1 time: 0.085183 Aug 31 09:52:45.927259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 329/664] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:52:45 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:45.938702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff04bc4-99a6-4157-8473-06a5ca972e4e"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:45.941138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:45.947420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:45.947896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:45.948326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:45.949038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:45.949484 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:45.949897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.026417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Invalid volume: volume 2ff04bc4-99a6-4157-8473-06a5ca972e4e is already attached to instances: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: POST /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/os-volume_attachments HTTP/1.1 Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 74 Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:52:46.028304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {"volumeAttachment": {"volumeId": "2ff04bc4-99a6-4157-8473-06a5ca972e4e"}} Aug 31 09:52:46.029918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Invalid volume: volume 2ff04bc4-99a6-4157-8473-06a5ca972e4e is already attached to instances: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'server_id': '30323acf-ca69-4a6a-b55e-2a9e538b59b3', 'body': {'volumeAttachment': {'volumeId': '2ff04bc4-99a6-4157-8473-06a5ca972e4e'}}} Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ff04bc4-99a6-4157-8473-06a5ca972e4e is already attached to instances: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:46.030742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ff04bc4-99a6-4157-8473-06a5ca972e4e is already attached to instances: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:46.032721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ff04bc4-99a6-4157-8473-06a5ca972e4e is already attached to instances: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 400 to user: Invalid volume: volume 2ff04bc4-99a6-4157-8473-06a5ca972e4e is already attached to instances: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-892d7421-5992-408f-befb-8eabddca6e3e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095258 Aug 31 09:52:46.034272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 336/665] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:52:45 2022] POST /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:52:46.039147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:46.039641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:46.045578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.046064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.046503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.047757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.048212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.048632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.072946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:52:46.147214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f1e27f44-97db-4539-9ca2-f444e39494f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 204 len: 0 microversion: 2.1 time: 0.111507 Aug 31 09:52:46.147719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 330/666] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:52:46 2022] DELETE /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:52:46.155893 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:46.156493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:46.163190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.163677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.164111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.164795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.165274 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.165697 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.293253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:46.301347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-22e0cae3-a33f-49fc-9a7e-f7b277c8d801 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1681 microversion: 2.1 time: 0.149266 Aug 31 09:52:46.301905 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 337/667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:46 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:47.323502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:47.324192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:47.331356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.331836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.332267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.332949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.333423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.333845 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.464934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:47.472583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a53e7e89-a3e0-470c-9dd2-b00eb36e2eda tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1681 microversion: 2.1 time: 0.153301 Aug 31 09:52:47.473175 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 331/668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:47 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:48.493752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:48.494363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:48.501114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.501602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.502037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.502727 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.503181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.503604 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.707984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:48.715801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-00da0f33-1995-4cf6-9662-1aeb888f0054 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1681 microversion: 2.1 time: 0.225908 Aug 31 09:52:48.716367 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 338/669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:48 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:49.493860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-bca9dad2-076a-405d-9eb2-db46701370e8 req-7469d8aa-8c06-4d27-84bc-6f61f8dd90b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30323acf-ca69-4a6a-b55e-2a9e538b59b3", "name": "network-vif-deleted", "tag": "0278d133-95eb-4631-a12e-46fb13bb1eec"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:49.504222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-bca9dad2-076a-405d-9eb2-db46701370e8 req-7469d8aa-8c06-4d27-84bc-6f61f8dd90b0 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.504721 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-bca9dad2-076a-405d-9eb2-db46701370e8 req-7469d8aa-8c06-4d27-84bc-6f61f8dd90b0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.505186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-bca9dad2-076a-405d-9eb2-db46701370e8 req-7469d8aa-8c06-4d27-84bc-6f61f8dd90b0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.516997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-bca9dad2-076a-405d-9eb2-db46701370e8 req-7469d8aa-8c06-4d27-84bc-6f61f8dd90b0 service nova] Creating event network-vif-deleted:0278d133-95eb-4631-a12e-46fb13bb1eec for instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 on hv-cinder-83754 Aug 31 09:52:49.521834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-bca9dad2-076a-405d-9eb2-db46701370e8 req-7469d8aa-8c06-4d27-84bc-6f61f8dd90b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031619 Aug 31 09:52:49.522435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 332/670] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:49.739938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:49.741053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:49.747611 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.748364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.748789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.749711 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.750202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.750814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.786639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.787135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.787565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.788012 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'fault' on Instance uuid 30323acf-ca69-4a6a-b55e-2a9e538b59b3 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:49.830816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:49.839894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f06c18a5-9c0c-4df5-9b68-8a012894ff2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 200 len: 1331 microversion: 2.1 time: 0.105891 Aug 31 09:52:49.840464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 339/671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:49 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:50.658730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.659433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:50.665592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.666084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.666525 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.667222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.667681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.668112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.702055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-09db6dbd-3b75-4401-ad13-9e4404a87cd0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments/8cc25e90-3cc2-4a8d-9d36-771d3e4e839b" status: 200 len: 194 microversion: 2.20 time: 0.048294 Aug 31 09:52:50.703374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 333/672] 10.222.0.25 () {60 vars in 1454 bytes} [Wed Aug 31 09:52:50 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments/8cc25e90-3cc2-4a8d-9d36-771d3e4e839b => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:52:50.774000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.774605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:50.781479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.781980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.782422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.783139 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.783599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.784027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.862591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.863308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:50.864135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=97 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:50.870339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.870920 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.871040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lazy-loading 'services' on Instance uuid 0fb4356f-6089-4087-9f63-a48ff6bcb08a {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:50.871443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.872232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.872791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.873352 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.891506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 HTTP/1.1 Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:52:50.894043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:52:50.895339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '30323acf-ca69-4a6a-b55e-2a9e538b59b3'} Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:50.896118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:52:50.897401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:50.898612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:50.898612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dcf09893-83fd-4792-8ee0-2499b061038f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 404 len: 111 microversion: 2.1 time: 0.037974 Aug 31 09:52:50.898612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 334/673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:50 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:52:50.904807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a193c4ec-64d9-42ec-8e67-efd96d9e2830 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '.version_select at 0x7f0b52821430>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.926993 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a193c4ec-64d9-42ec-8e67-efd96d9e2830 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523300437" status: 202 len: 0 microversion: 2.1 time: 0.025706 Aug 31 09:52:50.931503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 335/674] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 31 09:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523300437 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:52:50.998630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d3a718eb-60ac-4ba8-9968-af21ed3986cb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments/8cc25e90-3cc2-4a8d-9d36-771d3e4e839b" status: 202 len: 0 microversion: 2.20 time: 0.228342 Aug 31 09:52:50.999494 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 340/675] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Aug 31 09:52:50 2022] DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments/8cc25e90-3cc2-4a8d-9d36-771d3e4e839b => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:52:51.008301 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.010493 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.019463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.020471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.021626 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.022963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.023826 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.024477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.057589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-36b1ea55-759f-472d-9ce5-b9f3492b962c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053192 Aug 31 09:52:51.058265 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 336/676] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 31 09:52:51 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:52:51.630903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.631482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.637632 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.638112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.638543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.639225 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.639669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.640615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.721916 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'services' on Instance uuid e5d0bc15-4bb1-46c5-82f5-ad82d487a65e {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:51.793554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-173fa49d-4303-4d2f-99a4-92314c6079c0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments/2ff04bc4-99a6-4157-8473-06a5ca972e4e" status: 202 len: 0 microversion: 2.1 time: 0.166671 Aug 31 09:52:51.794178 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 341/677] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:52:51 2022] DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments/2ff04bc4-99a6-4157-8473-06a5ca972e4e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:51.802425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.804539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.810837 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.811329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.811765 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.812753 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.813233 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.813658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.817368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:51.845701 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6037ea55-0846-4d91-8124-613286db735e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Aug 31 09:52:51.846451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 337/678] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:51 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:52.071280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:52.073618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:52.080455 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.080941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.081400 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.082085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.082559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.082981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.112016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0baacf9c-6901-44a2-b977-1b917065b179 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045066 Aug 31 09:52:52.112561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 342/679] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 31 09:52:52 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:52:52.858226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:52.860359 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:52.866543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.867017 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.867445 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.868138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.868777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.869306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.902718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-74fc5620-ef34-4acd-9b73-0563aaad4176 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048347 Aug 31 09:52:52.903281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 338/680] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:52 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:53.124107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.126705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.133260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.133741 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.134172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.134863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.135852 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.136280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.167853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-93f5a9a6-4352-45ed-bf6e-5c7ac9d597d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047652 Aug 31 09:52:53.168442 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 343/681] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:53.233138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.233662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.239516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.240003 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.240435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.241170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.241641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.242056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.271821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:52:53.346125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-81c0d56e-508f-4f64-947f-de6b32f2a8e9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 204 len: 0 microversion: 2.20 time: 0.116564 Aug 31 09:52:53.346819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 339/682] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 31 09:52:53 2022] DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:52:53.357151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.357768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.363695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.364215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.364652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.365383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.365841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.366269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.499970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.508277 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.509752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.510933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b65a91ab-f2ed-4d27-a39a-e9fc99f84c78 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.159431 Aug 31 09:52:53.511496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 344/683] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:53.916398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.918657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.925004 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.925490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.925925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.926611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.927065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.927487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.957345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cf3b576f-0190-4182-baa8-cc921d53fda5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045391 Aug 31 09:52:53.957895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 340/684] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:52:54.017328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:54.017817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:54.023631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.024114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.024547 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.025288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.025738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.026156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.050386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:52:54.125510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7380d2c9-c629-44e4-a25d-b845b6e8e65b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 204 len: 0 microversion: 2.1 time: 0.111687 Aug 31 09:52:54.126207 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 345/685] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:52:54 2022] DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:52:54.134166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:54.134761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:54.141214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.141640 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.142076 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.142762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.143217 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.143644 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.478518 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.486581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-88ba8822-dd6e-41a9-881c-4bd84853992e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1681 microversion: 2.1 time: 0.356271 Aug 31 09:52:54.487143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 341/686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:54 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1681 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:54.535060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:54.535754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:54.541688 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.542172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.542609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.543296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.543754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.544177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.672879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.680951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.682414 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.683572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-14de9f03-3398-43d8-b34e-cddef733213f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.153258 Aug 31 09:52:54.684136 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 346/687] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:54 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:55.508727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:55.509587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:55.516925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.517443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.517874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.518561 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.519011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.519430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.649623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.658121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-81a87143-3bc8-492c-9499-41f373d4082b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1681 microversion: 2.1 time: 0.153879 Aug 31 09:52:55.658694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 342/688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:55 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:55.706645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:55.707249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:55.713676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.714158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.714586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.715263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.715714 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.716158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.841827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.849757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.851180 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.852323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7af982a4-d3f0-43f8-aea6-ddf416b7dc4c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.149537 Aug 31 09:52:55.852910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 347/689] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:55 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:56.679990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:56.680601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:56.688582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.689177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.689838 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.690541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.690994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.691417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.876420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:56.877127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:56.881156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:56.885919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.886533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.887043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.888398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.888923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.889645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.920360 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:56.933074 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-68dae85f-c31e-4eb1-aef2-6e4c59858f36 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1681 microversion: 2.1 time: 0.257008 Aug 31 09:52:56.933752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 343/690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:56 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:57.199341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:57.209620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:57.211193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:57.213045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-77b81f52-1072-4c47-959e-3db1399f167c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1723 microversion: 2.20 time: 0.340722 Aug 31 09:52:57.213913 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 348/691] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:56 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:57.685690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-a1468f85-247f-4cc4-a400-275014fe20e3 req-7a3804a0-3dd2-4284-b324-fe13daf9cb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d0bc15-4bb1-46c5-82f5-ad82d487a65e", "name": "network-vif-deleted", "tag": "f2d9c453-c42a-42fe-9b7a-22639ee0f7fe"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:57.706485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:57.709139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a1468f85-247f-4cc4-a400-275014fe20e3 req-7a3804a0-3dd2-4284-b324-fe13daf9cb54 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.709909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a1468f85-247f-4cc4-a400-275014fe20e3 req-7a3804a0-3dd2-4284-b324-fe13daf9cb54 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.710729 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a1468f85-247f-4cc4-a400-275014fe20e3 req-7a3804a0-3dd2-4284-b324-fe13daf9cb54 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.749262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-a1468f85-247f-4cc4-a400-275014fe20e3 req-7a3804a0-3dd2-4284-b324-fe13daf9cb54 service nova] Creating event network-vif-deleted:f2d9c453-c42a-42fe-9b7a-22639ee0f7fe for instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e on hv-cinder-83754 Aug 31 09:52:57.756944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-a1468f85-247f-4cc4-a400-275014fe20e3 req-7a3804a0-3dd2-4284-b324-fe13daf9cb54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145549 Aug 31 09:52:57.760605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 344/692] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:57.882392 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-40793e84-2e2a-4613-95c9-af9692398356 req-05f2f65b-72e8-4bcb-9da5-aab41ec898d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb4356f-6089-4087-9f63-a48ff6bcb08a", "name": "network-vif-deleted", "tag": "19b25659-ded4-4d88-b3b1-b0eeeef214d3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:57.913388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-40793e84-2e2a-4613-95c9-af9692398356 req-05f2f65b-72e8-4bcb-9da5-aab41ec898d0 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.914254 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-40793e84-2e2a-4613-95c9-af9692398356 req-05f2f65b-72e8-4bcb-9da5-aab41ec898d0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.914885 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-40793e84-2e2a-4613-95c9-af9692398356 req-05f2f65b-72e8-4bcb-9da5-aab41ec898d0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.945427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-40793e84-2e2a-4613-95c9-af9692398356 req-05f2f65b-72e8-4bcb-9da5-aab41ec898d0 service nova] Creating event network-vif-deleted:19b25659-ded4-4d88-b3b1-b0eeeef214d3 for instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a on hv-cinder-83754 Aug 31 09:52:57.956769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:57.957554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:57.969699 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-40793e84-2e2a-4613-95c9-af9692398356 req-05f2f65b-72e8-4bcb-9da5-aab41ec898d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100415 Aug 31 09:52:57.970305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 349/693] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:57.974666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.975163 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.975681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.976287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.976748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.978751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.041094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.041905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.042504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.043196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'fault' on Instance uuid e5d0bc15-4bb1-46c5-82f5-ad82d487a65e {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:58.122901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.135048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9e4acf79-26ba-41a9-9b88-f029c9f7a1b2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 200 len: 1331 microversion: 2.1 time: 0.183382 Aug 31 09:52:58.135980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 345/694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:57 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 1331 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:58.237110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:58.238260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:58.245725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.246559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.247163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.248275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.249740 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.250351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.284298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.284783 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.285253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.285709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lazy-loading 'fault' on Instance uuid 0fb4356f-6089-4087-9f63-a48ff6bcb08a {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:58.330725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.339203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.340899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.342191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2691715a-e0e3-4641-9015-0a77135dda15 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 200 len: 1372 microversion: 2.20 time: 0.110060 Aug 31 09:52:58.343396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 350/695] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:58 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:59.157398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:59.158012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:59.164327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.164809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.165308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.166038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.166496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.166915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.182019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e HTTP/1.1 Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:52:59.183662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:52:59.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'e5d0bc15-4bb1-46c5-82f5-ad82d487a65e'} Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:59.186243 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:52:59.188315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.189620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:59.189620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3ee56611-5040-46dc-95b5-ca3e5db311bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 404 len: 111 microversion: 2.1 time: 0.031627 Aug 31 09:52:59.189620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 346/696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:59 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:52:59.194761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8b4e4fc0-16fb-4bd4-a3c7-824d98bb7551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '.version_select at 0x7f0b526eb670>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:59.215332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8b4e4fc0-16fb-4bd4-a3c7-824d98bb7551 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362967216" status: 202 len: 0 microversion: 2.1 time: 0.024334 Aug 31 09:52:59.215902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 351/697] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 31 09:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362967216 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:59.366234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:59.367107 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:59.375107 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.375712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.376244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.377119 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.377662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.378156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.394503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] HTTP exception thrown: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Request method failure captured: Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a HTTP/1.1 Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy31cExfG4ps9FrZ47yAbijG_SfwQk_BCA0VlXav09mPaz4KqynNEw4MRPGwG9DU0D11Iu9lR8htdlrI0AfL4QbadNn2aFOApPb2qh8wPqQblriVxFMye7ktpDoUdHVUKbprsbPz3ki9kUQY-JSXQ7K8kKEYi8cFpoJZ3-BpxlKd06E Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:52:59.396129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16af15e86174ab1b9344d35ffe0844d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 468522570ba7419c87da6d05fc0d1ff1 Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:52:59.397794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '0fb4356f-6089-4087-9f63-a48ff6bcb08a'} Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:59.398712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:52:59.400117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:52:59.401384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Returning 404 to user: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:59.401384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9ca6d4e6-3b63-44f5-83b2-70864aa9cf65 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 404 len: 111 microversion: 2.20 time: 0.036893 Aug 31 09:52:59.401384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 347/698] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:59 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:52:59.409577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-93053fa4-183c-48e0-bf5e-092eea0b122c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '.version_select at 0x7f0b5280a430>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:59.430843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-93053fa4-183c-48e0-bf5e-092eea0b122c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502316576" status: 204 len: 0 microversion: 2.20 time: 0.024881 Aug 31 09:52:59.431457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 352/699] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Aug 31 09:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502316576 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:52:59.879897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-80164cc5-a6da-40b0-9a61-9cac8725c7cf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: .version_select at 0x7f0b526d1310>, body: {"keypair": {"name": "tempest-keypair-1485556790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP2x5uAPLfv0RwFRIAcMIDySLailfUXYNX6s65Z+m8U8vntLG1FMB1YpoM7C0PQLdpCvWos1nUpq5Kx/5wE09WWR3Wf5fWLtZrHNwXHr2bTjssFyvlq52f58XlSBAf08w=="}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:59.895393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-80164cc5-a6da-40b0-9a61-9cac8725c7cf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:59.900276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-80164cc5-a6da-40b0-9a61-9cac8725c7cf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:59.923218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-80164cc5-a6da-40b0-9a61-9cac8725c7cf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047198 Aug 31 09:52:59.923820 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 348/700] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:52:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:00.050266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d6bbc0e8-8658-4326-b3fc-01425c100c20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'create', calling method: .version_select at 0x7f0b527b0ca0>, body: {"keypair": {"name": "tempest-keypair-1456552439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtJVfmRt95Y+v+aYgaha1xcB4PcxRhj45Rf26nEfyHcul14Iff/sF9ECZKyPfc/upE9G7bBmKpDd9mA9kh2zxHjPyD2KouDAMg0IEbsrA6c2Uf4Zu9kTjeOT2q3oszcrA=="}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:00.067589 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-d6bbc0e8-8658-4326-b3fc-01425c100c20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for project d16af15e86174ab1b9344d35ffe0844d. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:00.078038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-d6bbc0e8-8658-4326-b3fc-01425c100c20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for user 468522570ba7419c87da6d05fc0d1ff1 and project d16af15e86174ab1b9344d35ffe0844d. Resources: {'key_pairs'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:00.102399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d6bbc0e8-8658-4326-b3fc-01425c100c20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056536 Aug 31 09:53:00.103046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 353/701] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Aug 31 09:53:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 09:53:01.302501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-441942380", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e"}], "security_groups": [{"name": "tempest-securitygroup--500025442"}], "key_name": "tempest-keypair-1485556790", "user_data": "}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:01.407726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1759404016", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69822186-16f7-448b-8ff0-bb87c58671c7"}], "security_groups": [{"name": "tempest-securitygroup--457821986"}], "key_name": "tempest-keypair-1456552439", "user_data": "}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:01.435164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] validate_networks() for [('4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:01.511577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] validate_networks() for [('69822186-16f7-448b-8ff0-bb87c58671c7', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:01.847802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:01.848501 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:01.849362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:01.850277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:01.850903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:01.862122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:01.862607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:01.863058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.863784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:01.864241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:01.864660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.882174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:01.886150 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:01.898304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:01.900650 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:01.935720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:01.936153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:01.937562 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:01.937981 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:01.938397 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:01.948629 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d78be4b4-adf2-46d9-b4bf-89c35fb5c871 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.650171 Aug 31 09:53:01.951192 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:01.951700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:01.952200 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.952947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:01.953432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:01.953858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.954238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 349/702] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:53:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:53:01.959195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f0f6e7b-53b3-4cc0-a556-2de0abb2be7c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:01.960032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3f0f6e7b-53b3-4cc0-a556-2de0abb2be7c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:01.977895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for project d16af15e86174ab1b9344d35ffe0844d. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:01.982859 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Getting quotas for user 468522570ba7419c87da6d05fc0d1ff1 and project d16af15e86174ab1b9344d35ffe0844d. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:01.996179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:01.998667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:02.039666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3f0f6e7b-53b3-4cc0-a556-2de0abb2be7c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:02.047654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3f0f6e7b-53b3-4cc0-a556-2de0abb2be7c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1241 microversion: 2.1 time: 0.092190 Aug 31 09:53:02.057709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7ea81e50-6964-487a-be42-bc1c2d970d80 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.655307 Aug 31 09:53:02.058701 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 354/703] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Aug 31 09:53:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 09:53:02.065833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 350/704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:01 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:02.070535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-55cf1ebf-6927-48b8-b13c-57f644a84f82 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:02.071500 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-55cf1ebf-6927-48b8-b13c-57f644a84f82 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:02.137592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-55cf1ebf-6927-48b8-b13c-57f644a84f82 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:02.146028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-55cf1ebf-6927-48b8-b13c-57f644a84f82 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:02.147676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-55cf1ebf-6927-48b8-b13c-57f644a84f82 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:02.148709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-55cf1ebf-6927-48b8-b13c-57f644a84f82 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1282 microversion: 2.20 time: 0.082087 Aug 31 09:53:02.149608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 351/705] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:02 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:03.069027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:03.069746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:03.076184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.076705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.077233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.077953 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.078402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.079018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.150406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:03.157972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7945686b-2e68-4575-9847-a4d4d3b7a08a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1293 microversion: 2.1 time: 0.093556 Aug 31 09:53:03.158526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 355/706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:03 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:03.172464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:03.173133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:03.181850 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.182580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.183213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.184213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.184856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.185487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.248398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:03.257142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:03.258584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:03.259678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8ae843b8-54ac-4986-9e46-93020357ddd3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1334 microversion: 2.20 time: 0.091914 Aug 31 09:53:03.260240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 352/707] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:03 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:04.179598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:04.180292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:04.187335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:04.187818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:04.188252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:04.188943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:04.189513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:04.189933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:04.281995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:04.282594 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:04.289027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:04.290781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:04.292867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:04.293342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:04.294102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:04.294619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:04.295054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:04.300170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e583da68-69fc-4365-a686-e89c4b7d0550 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1299 microversion: 2.1 time: 0.124458 Aug 31 09:53:04.301261 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 356/708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:04 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:04.372120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:04.381172 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:04.382918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:04.384252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cb08c819-0ef9-47df-80ac-a1988782c2dd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1340 microversion: 2.20 time: 0.106544 Aug 31 09:53:04.384908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 353/709] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:04 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:05.323292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:05.324884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:05.333862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.334661 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.335431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.337434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.338104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.338695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.409133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:05.409808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:05.417129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.417627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.418068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.418771 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.419225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.419648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.608586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:05.617788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3b29ca51-db82-487f-97d7-d9415321d417 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.298911 Aug 31 09:53:05.618382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 357/710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:05 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:05.636759 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-af914f4b-98cb-4570-a6e8-202f5a03878a req-9d1966c1-05d8-45ae-b837-4c08fbef992e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d701452f-8a93-4c9c-8225-7a2d1747290e", "tag": "8c0cc885-7067-472e-aa12-db0e5b516da1"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:05.646553 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-af914f4b-98cb-4570-a6e8-202f5a03878a req-9d1966c1-05d8-45ae-b837-4c08fbef992e service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.647129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-af914f4b-98cb-4570-a6e8-202f5a03878a req-9d1966c1-05d8-45ae-b837-4c08fbef992e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.647683 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-af914f4b-98cb-4570-a6e8-202f5a03878a req-9d1966c1-05d8-45ae-b837-4c08fbef992e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-af914f4b-98cb-4570-a6e8-202f5a03878a req-9d1966c1-05d8-45ae-b837-4c08fbef992e service nova] Creating event network-changed:8c0cc885-7067-472e-aa12-db0e5b516da1 for instance d701452f-8a93-4c9c-8225-7a2d1747290e on hv-cinder-83754 Aug 31 09:53:05.663568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:05.669085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-af914f4b-98cb-4570-a6e8-202f5a03878a req-9d1966c1-05d8-45ae-b837-4c08fbef992e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037740 Aug 31 09:53:05.670338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 358/711] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:05.674631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:05.676067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:05.677199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-af1f0c51-625d-4cc6-8e40-f18fd05265d1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.273700 Aug 31 09:53:05.677934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 354/712] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:05 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:05.933167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-b4f0fa01-9326-4db1-b7b6-153bc1c429ed req-b8840bc3-29a6-4f23-8e41-cf9f6c82d903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:05.945268 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-b4f0fa01-9326-4db1-b7b6-153bc1c429ed req-b8840bc3-29a6-4f23-8e41-cf9f6c82d903 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.946778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-b4f0fa01-9326-4db1-b7b6-153bc1c429ed req-b8840bc3-29a6-4f23-8e41-cf9f6c82d903 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.947703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-b4f0fa01-9326-4db1-b7b6-153bc1c429ed req-b8840bc3-29a6-4f23-8e41-cf9f6c82d903 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.954556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:05.966954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-b4f0fa01-9326-4db1-b7b6-153bc1c429ed req-b8840bc3-29a6-4f23-8e41-cf9f6c82d903 service nova] Creating event network-changed:3166ec8b-10cf-45f0-a421-f6337342ab3b for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 on hv-cinder-83754 Aug 31 09:53:05.983889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-b4f0fa01-9326-4db1-b7b6-153bc1c429ed req-b8840bc3-29a6-4f23-8e41-cf9f6c82d903 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052810 Aug 31 09:53:05.984637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 359/713] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:06.638932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:06.640249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:06.646608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:06.647086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:06.647520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:06.648199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:06.648652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:06.649100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:06.708747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:06.709575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:06.716232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:06.716722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:06.717204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:06.717943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:06.718398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:06.718844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:06.777176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:06.784911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ed97987c-685c-41ae-a423-d4721b3083ac tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.149739 Aug 31 09:53:06.785507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 355/714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:06 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:06.848102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:06.856337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:06.857816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:06.860050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4f923626-bfe7-4dea-b457-49fe846ae8e5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.155761 Aug 31 09:53:06.861053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 360/715] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:06 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:07.804783 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:07.805542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:07.812818 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:07.813325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:07.813762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:07.814578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:07.815054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:07.815493 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:07.882939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:07.883673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:07.890382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:07.890861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:07.891291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:07.891984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:07.892430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:07.893268 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:07.954541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:07.962296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-87f2921e-69e6-4f20-8bad-fb33980ee396 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.161347 Aug 31 09:53:07.962880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 356/716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:07 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:08.022579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:08.031270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:08.032716 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:08.033841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-88b482ef-baa1-416d-bfe8-576140577702 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.154868 Aug 31 09:53:08.034396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 361/717] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:07 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:08.983216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:08.983908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:08.990862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:08.991364 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:08.992088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:08.992780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:08.993434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:08.993791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:09.010565 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:09.055926 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:09.056535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:09.064037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:09.064539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:09.065191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:09.065896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:09.066355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:09.066780 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:09.153510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:09.162036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d431481b-60d9-4ac2-8d73-f1a48a0e8ad2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.182796 Aug 31 09:53:09.162840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 357/718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:08 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:09.298858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:09.306972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:09.308410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:09.309549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3dcdbd64-4ce5-4cad-b305-730f151494be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.257565 Aug 31 09:53:09.310110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 362/719] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:09 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:10.188402 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:10.189040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:10.195465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:10.195950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:10.196388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:10.197105 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:10.197568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:10.197992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:10.326770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:10.331945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:10.332570 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:10.334539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-50287de5-69f4-4c30-9452-ccd437d496e8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.150771 Aug 31 09:53:10.335115 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 358/720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:10 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:10.339016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:10.339509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:10.339951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:10.340655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:10.341150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:10.341584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:10.468794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:10.476757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:10.478233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:10.479337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5d30e50b-d683-452f-8138-33102058036e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.151652 Aug 31 09:53:10.479899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 363/721] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:10 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:11.355521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:11.356056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:11.362416 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.362902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.363335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.364030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.364489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.364913 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.495870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:11.502954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:11.503582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:11.504220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dede7104-be31-4d71-9697-9edebd696678 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.152555 Aug 31 09:53:11.504807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 359/722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:11 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:11.509909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.510391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.510829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.511559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.512014 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.512441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.647070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:11.655046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:11.656471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:11.657587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d5287377-61d4-42be-9b5c-be3948140013 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.159183 Aug 31 09:53:11.658140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 364/723] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:11 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:12.525036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:12.525648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:12.527507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:12.528620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=14 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:12.536699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:12.537241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:12.537667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:12.538457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:12.538936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:12.539345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:12.672814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:12.679882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:12.680380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f917b3a0-2132-47c5-8eb5-bf09de711048 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.159184 Aug 31 09:53:12.680636 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:12.680884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 360/724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:12 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:12.682815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:12.683464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=10 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:12.690387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:12.690883 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:12.691336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:12.692064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:12.692518 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:12.692941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:12.818912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:12.827625 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:12.829093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:12.830195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5e931dc0-fb36-4374-8a26-7bb89496364b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.154105 Aug 31 09:53:12.830752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 365/725] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:12 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:13.703467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:13.704086 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:13.712068 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:13.712792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:13.713236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:13.713939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:13.714731 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:13.715164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:13.733108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-ff592b8f-de6f-4926-ae2a-0bfc827c5411 req-b5429002-a450-4d14-824b-158df817062e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d701452f-8a93-4c9c-8225-7a2d1747290e", "name": "network-vif-plugged", "status": "completed", "tag": "8c0cc885-7067-472e-aa12-db0e5b516da1"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:13.745437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ff592b8f-de6f-4926-ae2a-0bfc827c5411 req-b5429002-a450-4d14-824b-158df817062e service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:13.746032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ff592b8f-de6f-4926-ae2a-0bfc827c5411 req-b5429002-a450-4d14-824b-158df817062e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:13.746689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ff592b8f-de6f-4926-ae2a-0bfc827c5411 req-b5429002-a450-4d14-824b-158df817062e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:13.758833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-ff592b8f-de6f-4926-ae2a-0bfc827c5411 req-b5429002-a450-4d14-824b-158df817062e service nova] Creating event network-vif-plugged:8c0cc885-7067-472e-aa12-db0e5b516da1 for instance d701452f-8a93-4c9c-8225-7a2d1747290e on hv-cinder-83754 Aug 31 09:53:13.764801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-ff592b8f-de6f-4926-ae2a-0bfc827c5411 req-b5429002-a450-4d14-824b-158df817062e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094933 Aug 31 09:53:13.765544 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 361/726] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:13.852315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:13.853019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:13.859673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:13.860775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:13.861482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:13.862066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:13.862924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:13.863377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:13.863793 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:13.868636 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b57d92af-f640-442a-8092-c8a0ddf6f136 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.169488 Aug 31 09:53:13.869357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 366/727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:13 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:14.000879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:14.009108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:14.010537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:14.011633 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b36da303-81e3-4854-87e0-688892778e4a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.163708 Aug 31 09:53:14.012543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 362/728] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:13 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:14.890743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:14.891365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:14.897822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:14.898307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:14.898743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:14.899450 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:14.899887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:14.900316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:15.031576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:15.034290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:15.034893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:15.039439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c2716026-c87e-4442-a0fc-23b35eec5ad0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1366 microversion: 2.1 time: 0.153097 Aug 31 09:53:15.040102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 367/729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:14 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:15.041153 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:15.041639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:15.042070 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:15.042755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:15.043206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:15.043622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:15.170387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:15.178325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:15.179767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:15.180869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cf9b5e71-c2f7-4fb2-b625-55afb0e53c9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.150409 Aug 31 09:53:15.181458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 363/730] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:15 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:15.804348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-78bc95d3-d91e-4616-81af-a15cf9122c4a req-8454560b-1784-497d-9c46-a375e8c816bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "name": "network-vif-plugged", "status": "completed", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:15.814110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-78bc95d3-d91e-4616-81af-a15cf9122c4a req-8454560b-1784-497d-9c46-a375e8c816bb service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:15.814520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-78bc95d3-d91e-4616-81af-a15cf9122c4a req-8454560b-1784-497d-9c46-a375e8c816bb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:15.814986 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-78bc95d3-d91e-4616-81af-a15cf9122c4a req-8454560b-1784-497d-9c46-a375e8c816bb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:15.826218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-78bc95d3-d91e-4616-81af-a15cf9122c4a req-8454560b-1784-497d-9c46-a375e8c816bb service nova] Creating event network-vif-plugged:3166ec8b-10cf-45f0-a421-f6337342ab3b for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 on hv-cinder-83754 Aug 31 09:53:15.831045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-78bc95d3-d91e-4616-81af-a15cf9122c4a req-8454560b-1784-497d-9c46-a375e8c816bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030436 Aug 31 09:53:15.831642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 368/731] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:16.060284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:16.060829 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:16.067520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:16.068002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:16.068437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:16.069161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:16.069615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:16.070046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:16.199554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:16.205123 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:16.205828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:16.207671 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fd63f325-8cdd-40d2-87b9-dedf70073420 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1556 microversion: 2.1 time: 0.151300 Aug 31 09:53:16.208245 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 364/732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:16 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:16.212083 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:16.212576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:16.213042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:16.213742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:16.214200 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:16.214629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:16.228000 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:16.228486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:16.234206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:16.234686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:16.235124 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:16.235810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:16.236263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:16.236680 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:16.312833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8714a58b-68cf-40eb-ac53-5c2269fe8654 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088382 Aug 31 09:53:16.313540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 365/733] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:53:16 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:16.385271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:16.394201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:16.395646 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:16.396759 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f42dc809-b084-4e40-84bd-786e8e60b26c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.196823 Aug 31 09:53:16.397366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 369/734] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:16 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:17.341286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-051023f0-ad06-4f05-82e0-56ea6ac902ff req-f9eda4b1-52ca-47fa-ab20-a3b0a40d58d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d701452f-8a93-4c9c-8225-7a2d1747290e", "tag": "8c0cc885-7067-472e-aa12-db0e5b516da1"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:17.350944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-051023f0-ad06-4f05-82e0-56ea6ac902ff req-f9eda4b1-52ca-47fa-ab20-a3b0a40d58d6 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:17.351423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-051023f0-ad06-4f05-82e0-56ea6ac902ff req-f9eda4b1-52ca-47fa-ab20-a3b0a40d58d6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:17.351847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-051023f0-ad06-4f05-82e0-56ea6ac902ff req-f9eda4b1-52ca-47fa-ab20-a3b0a40d58d6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:17.363583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-051023f0-ad06-4f05-82e0-56ea6ac902ff req-f9eda4b1-52ca-47fa-ab20-a3b0a40d58d6 service nova] Creating event network-changed:8c0cc885-7067-472e-aa12-db0e5b516da1 for instance d701452f-8a93-4c9c-8225-7a2d1747290e on hv-cinder-83754 Aug 31 09:53:17.368594 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-051023f0-ad06-4f05-82e0-56ea6ac902ff req-f9eda4b1-52ca-47fa-ab20-a3b0a40d58d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031465 Aug 31 09:53:17.369641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 366/735] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:17.419099 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:17.419737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:17.426658 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:17.427186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:17.427625 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:17.428317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:17.428767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:17.429217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:17.586198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:17.594766 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:17.596198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:17.597322 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c7488ed3-8813-434d-88d8-b0a54cb54c99 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.182076 Aug 31 09:53:17.597879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 370/736] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:17 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:18.619514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:18.620219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:18.626902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:18.627393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:18.627831 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:18.628531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:18.629012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:18.629444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:18.763401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:18.771377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:18.772840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:18.774008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-476a6ca6-82fd-4550-bc8e-5ec3c668ce89 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1407 microversion: 2.20 time: 0.158800 Aug 31 09:53:18.774565 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 367/737] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:18 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:19.798105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:19.798718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:19.805222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:19.805715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:19.806158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:19.806854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:19.807311 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:19.807734 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:19.934744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:19.944337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:19.945998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:19.947169 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-39fe5bd3-7a96-4141-b816-71847ef870d4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1599 microversion: 2.20 time: 0.154234 Aug 31 09:53:19.947737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 371/738] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:19 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:19.968933 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:19.969492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:19.975899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:19.976384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:19.976822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:19.977607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:19.978070 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:19.978496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:20.062847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4a6e02ff-3fe7-4174-80ba-464e74058350 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097787 Aug 31 09:53:20.063441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 368/739] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Aug 31 09:53:19 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:53:20.978822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-a85aeb9e-f3bf-4b99-b70d-4d9aa888b23c req-9ed3a8b6-bd37-4f00-bdf7-083c0f948f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:20.991963 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a85aeb9e-f3bf-4b99-b70d-4d9aa888b23c req-9ed3a8b6-bd37-4f00-bdf7-083c0f948f17 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:20.992445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a85aeb9e-f3bf-4b99-b70d-4d9aa888b23c req-9ed3a8b6-bd37-4f00-bdf7-083c0f948f17 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:20.992877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a85aeb9e-f3bf-4b99-b70d-4d9aa888b23c req-9ed3a8b6-bd37-4f00-bdf7-083c0f948f17 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:21.006044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-a85aeb9e-f3bf-4b99-b70d-4d9aa888b23c req-9ed3a8b6-bd37-4f00-bdf7-083c0f948f17 service nova] Creating event network-changed:3166ec8b-10cf-45f0-a421-f6337342ab3b for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 on hv-cinder-83754 Aug 31 09:53:21.010979 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-a85aeb9e-f3bf-4b99-b70d-4d9aa888b23c req-9ed3a8b6-bd37-4f00-bdf7-083c0f948f17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035873 Aug 31 09:53:21.011582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 372/740] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:25.151391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:25.151892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:25.158277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.158760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.159215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.159888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.160342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.160763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.238713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lazy-loading 'services' on Instance uuid 0150f767-f03e-4999-aaba-5ef9d302fa94 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:25.308536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9f6c5d66-caeb-41ec-9e4a-0820d084dd0f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments/64691545-8266-4754-838e-6e5dec134f13" status: 202 len: 0 microversion: 2.1 time: 0.161611 Aug 31 09:53:25.309189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 369/741] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:53:25 2022] DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments/64691545-8266-4754-838e-6e5dec134f13 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:53:25.318820 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:25.321060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:25.328117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.328606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.329130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.330403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.330936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.331383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.360720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-27ae87c4-f8e0-4e78-9bd1-b96e355c0e15 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046081 Aug 31 09:53:25.361244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 373/742] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:25 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:25.724695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:25.725325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:25.731463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.731977 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.732415 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.733133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.733597 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.734021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.758101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:25.832278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3fc9e4b1-cf47-4576-baf7-9b21d4d50a46 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 204 len: 0 microversion: 2.1 time: 0.111605 Aug 31 09:53:25.832857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 370/743] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:25 2022] DELETE /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:25.840657 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:25.841866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:25.847805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.848294 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.848736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.849453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.849914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.850340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.988118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:25.995897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-72b0237c-6e9b-4644-9b34-4a88b4fb3f21 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1576 microversion: 2.1 time: 0.158987 Aug 31 09:53:25.996469 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 374/744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:25 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:26.373189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:26.375408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:26.381778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.382262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.382697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.383382 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.383833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.384255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.413882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eb290cda-65ee-4be3-a329-2a80a7915735 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Aug 31 09:53:26.414426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 371/745] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:26 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:27.018462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:27.019086 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:27.021522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:27.026717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.027203 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.027630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.028309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.028772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.029226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.159517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:27.167487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-02a47d02-e424-4a8e-8e8f-be9397cd9389 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1576 microversion: 2.1 time: 0.152836 Aug 31 09:53:27.168091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 375/746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:27 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:27.426707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:27.428911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:27.436125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.436874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.437336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.438027 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.438484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.438907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.467540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eddb6755-bb83-4237-9661-6ae59d40b877 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Aug 31 09:53:27.468125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 372/747] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:27 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:28.189177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:28.189816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:28.196295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.196775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.197269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.197951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.198398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.198814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.335421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:28.343601 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-95fd556d-97c9-4616-8e92-7b13e78723ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1576 microversion: 2.1 time: 0.158506 Aug 31 09:53:28.344429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 376/748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:28 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:28.479254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:28.481335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:28.483825 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:28.488875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.489394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.489828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.490524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.490976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.491400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.518779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:28.523605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-149040c3-e5a1-4867-9bd4-b91669c2bad9 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048440 Aug 31 09:53:28.524180 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 373/749] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:28 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:53:28.598047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:28.598546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:28.604371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.604859 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.605398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.606126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.606579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.607034 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.633423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:28.636263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:28.717815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-400f66bb-da15-469c-9954-4708fda544ea tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 204 len: 0 microversion: 2.1 time: 0.123188 Aug 31 09:53:28.718656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 377/750] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:28 2022] DELETE /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:53:28.727306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:28.728263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:28.738383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.738812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.739254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.739970 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.740429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.740857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:29.054966 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:29.063509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f676de45-031e-438e-a86e-b41489a49c38 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1689 microversion: 2.1 time: 0.340369 Aug 31 09:53:29.064079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 374/751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:28 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1689 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:29.365887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:29.366543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:29.382427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:29.383201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:29.383819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:29.384600 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:29.384988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:29.385435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:29.439509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-e0aaa2b9-0652-40af-822e-7421282a00e7 req-b4ea4121-4c45-4edd-9cd2-9f2679f9110e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a576c4-6c87-49fd-b00b-ea140c968c8a", "name": "network-vif-deleted", "tag": "96048666-ee31-454b-8cf1-204196456392"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:29.449140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e0aaa2b9-0652-40af-822e-7421282a00e7 req-b4ea4121-4c45-4edd-9cd2-9f2679f9110e service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:29.449616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e0aaa2b9-0652-40af-822e-7421282a00e7 req-b4ea4121-4c45-4edd-9cd2-9f2679f9110e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:29.450046 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e0aaa2b9-0652-40af-822e-7421282a00e7 req-b4ea4121-4c45-4edd-9cd2-9f2679f9110e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:29.462042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-e0aaa2b9-0652-40af-822e-7421282a00e7 req-b4ea4121-4c45-4edd-9cd2-9f2679f9110e service nova] Creating event network-vif-deleted:96048666-ee31-454b-8cf1-204196456392 for instance 68a576c4-6c87-49fd-b00b-ea140c968c8a on hv-cinder-83754 Aug 31 09:53:29.462688 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:29.467921 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-e0aaa2b9-0652-40af-822e-7421282a00e7 req-b4ea4121-4c45-4edd-9cd2-9f2679f9110e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Aug 31 09:53:29.469188 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 375/752] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:29.472726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a73bfca2-00c5-452d-a927-5336e0e1b6c0 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1510 microversion: 2.1 time: 0.111424 Aug 31 09:53:29.473341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 378/753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:29 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1510 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:30.086090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:30.086797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:30.095396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:30.095893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:30.096331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:30.097084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:30.097550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:30.097976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:30.234363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:30.242258 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f1ab53f1-99a7-488a-be29-661383f897aa tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1689 microversion: 2.1 time: 0.160941 Aug 31 09:53:30.242831 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 376/754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:30 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:30.493904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:30.494509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:30.501565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:30.502042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:30.502471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:30.503152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:30.503609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:30.504028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:30.567363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:30.575191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8b2a6276-0458-4106-846e-33d68495a58a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1510 microversion: 2.1 time: 0.085274 Aug 31 09:53:30.576414 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 379/755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:30 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:31.264695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:31.265338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:31.271283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:31.271761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:31.272190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:31.272866 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:31.273336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:31.273755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:31.399161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:31.406762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f7319538-dc04-4b5d-a962-c281545502c6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1689 microversion: 2.1 time: 0.146490 Aug 31 09:53:31.407330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 377/756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:31 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:31.596006 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:31.596610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:31.603041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:31.603462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:31.603891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:31.604563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:31.605032 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:31.605447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:31.665673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:31.673755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-66d546b8-75dc-491b-8790-8510a059c7a5 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1510 microversion: 2.1 time: 0.081580 Aug 31 09:53:31.674318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 380/757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:31 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1510 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:32.427138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:32.427836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:32.434192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:32.434674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:32.435111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:32.435797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:32.436253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:32.436929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:32.565083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:32.572899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fc105f1d-e701-4b5e-bfdc-401646032b07 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1689 microversion: 2.1 time: 0.149762 Aug 31 09:53:32.573763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 378/758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:32 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:32.695764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:32.696303 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:32.703305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:32.703793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:32.704228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:32.704933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:32.705376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:32.705797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:32.770401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:32.778081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-00f584fc-97da-46c3-8861-082ace114843 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1225 microversion: 2.1 time: 0.086316 Aug 31 09:53:32.779559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 381/759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:32 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:33.594925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:33.595575 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:33.601674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.602166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.602609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.603310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.603773 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.604201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.799053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:33.799702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:33.806169 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.806662 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.807104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.807802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.808263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.808684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.823849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:33.834666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0ea61fe2-635e-4f16-8483-d7edbb27fb4c tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1689 microversion: 2.1 time: 0.244017 Aug 31 09:53:33.848213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 379/760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:33 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:33.848402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.848402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.848402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.848402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lazy-loading 'fault' on Instance uuid 68a576c4-6c87-49fd-b00b-ea140c968c8a {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:33.883818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:33.892146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f9581503-48a9-43aa-82ac-ebcee824b4f2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 200 len: 1230 microversion: 2.1 time: 0.096969 Aug 31 09:53:33.892719 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 382/761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:33 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:34.278553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-d6d30f28-08ba-4f5b-9b01-19e4aa98ff22 req-3995b8b9-3fe5-4b11-918e-434e8f195218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0150f767-f03e-4999-aaba-5ef9d302fa94", "name": "network-vif-deleted", "tag": "d542308a-b45c-47b1-8483-16192cde0e91"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:34.289132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d6d30f28-08ba-4f5b-9b01-19e4aa98ff22 req-3995b8b9-3fe5-4b11-918e-434e8f195218 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.289620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d6d30f28-08ba-4f5b-9b01-19e4aa98ff22 req-3995b8b9-3fe5-4b11-918e-434e8f195218 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.290054 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d6d30f28-08ba-4f5b-9b01-19e4aa98ff22 req-3995b8b9-3fe5-4b11-918e-434e8f195218 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.301912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-d6d30f28-08ba-4f5b-9b01-19e4aa98ff22 req-3995b8b9-3fe5-4b11-918e-434e8f195218 service nova] Creating event network-vif-deleted:d542308a-b45c-47b1-8483-16192cde0e91 for instance 0150f767-f03e-4999-aaba-5ef9d302fa94 on hv-cinder-83754 Aug 31 09:53:34.307332 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-d6d30f28-08ba-4f5b-9b01-19e4aa98ff22 req-3995b8b9-3fe5-4b11-918e-434e8f195218 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Aug 31 09:53:34.308698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 380/762] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:34.855807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:34.857067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:34.863522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.864020 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.864459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.865266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.865726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.866158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.897459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.897949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.898388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.898836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lazy-loading 'fault' on Instance uuid 0150f767-f03e-4999-aaba-5ef9d302fa94 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:34.915512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:34.916604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:34.923552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.924349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.924892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.925692 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.926404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.926959 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.940590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:34.941768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] HTTP exception thrown: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Request method failure captured: Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a HTTP/1.1 Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy6mVIvQVcLkVy7cMy-Xpfme2Ur2Xo5Iop84FneswGvRPKJgvVEv-d2i2jdWurhLb4GzgY7L70J_aHG_BY7RgqDCtMWfW__OGEd8SY1ItEq6Yo_q31iJyXuQZUfwXSH6kcOpuKlPtwlBMAevOJZrXX_GKX7rI0WXBkb9VUDazgn_mVI Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:53:34.943417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6e3fe84eb42b4a1a70e76b5de9fa2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-TestVolumeBootPattern-671425473 Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-TestVolumeBootPattern-671425473-project Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 5669f5e5dcd74e01b4fb7c1bd512bd82 Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-TestVolumeBootPattern-671425473-project Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 09:53:34.944774 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '68a576c4-6c87-49fd-b00b-ea140c968c8a'} Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:34.945930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 09:53:34.947164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:34.948303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Returning 404 to user: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:34.948303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-94fd8fcc-1987-4d3f-8e77-d62ed5b47f08 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 404 len: 111 microversion: 2.1 time: 0.033983 Aug 31 09:53:34.948303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 381/763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:34 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:53:34.953745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9e28db1a-c636-4576-9468-e4a0eea668bf tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 200 len: 1335 microversion: 2.1 time: 0.101713 Aug 31 09:53:34.954493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 383/764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:34 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:35.049149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-975930977", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2048261769", "security_groups": [{"name": "tempest-secgroup-smoke-67122470"}], "block_device_mapping_v2": [{"uuid": "c808ca21-da9b-4b4c-b237-384b98ebef22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "017403cb-7130-4780-82b1-0da472342b0b"}]}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:35.181965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] validate_networks() for [('017403cb-7130-4780-82b1-0da472342b0b', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:35.556881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:35.557370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:35.557841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:35.558244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:35.558652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:35.568220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.568697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.569162 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.569885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.570339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.570759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.587155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:35.590954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for user 5669f5e5dcd74e01b4fb7c1bd512bd82 and project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:35.647468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:35.649769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c808ca21-da9b-4b4c-b237-384b98ebef22',volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:35.775912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b1fe9d2e-afa3-44c4-a9e7-158f1b5f854e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.730586 Aug 31 09:53:35.776734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 382/765] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:53:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:53:35.787698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5ea7c0d9-94d0-4f13-b40e-accbffd87a6c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:35.788314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5ea7c0d9-94d0-4f13-b40e-accbffd87a6c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:35.840842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5ea7c0d9-94d0-4f13-b40e-accbffd87a6c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:35.847943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5ea7c0d9-94d0-4f13-b40e-accbffd87a6c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1094 microversion: 2.1 time: 0.064019 Aug 31 09:53:35.848555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 384/766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:35 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:35.974442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:35.975044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 0150f767-f03e-4999-aaba-5ef9d302fa94] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:35.981580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.982068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.982503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.983429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.990058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.990492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.004672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] HTTP exception thrown: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 could not be found. Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Request method failure captured: Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 HTTP/1.1 Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy38rhyCWbhrWtX4ZXPzZ8Svs_WJ0Ldq5jcu2O8coUQH-O-yM9_WeD23tE_uxwq-ZWZox_aBUTiH8Zqr5L57Exj0BpSGO-n4ysILMuW_bASeu2tUuEPRhY8FYvcPyz2tpUQ_eNzXwkJokzuCOEJ8VBvnoGfwLJdX9b2Bb9npRJqqkaI Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:53:36.006331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089a845bce2542969b7e6f013b28d928"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089a845bce2542969b7e6f013b28d928", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 79acdbc2c11c4459928eab5b83a6755d Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 could not be found. Aug 31 09:53:36.008022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '0150f767-f03e-4999-aaba-5ef9d302fa94'} Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 could not be found. Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:36.008948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 could not be found. Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 could not be found. Aug 31 09:53:36.010411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:36.011663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Returning 404 to user: Instance 0150f767-f03e-4999-aaba-5ef9d302fa94 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:36.011663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-707ce977-1133-4a70-9a5f-bd66f46b4112 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94" status: 404 len: 111 microversion: 2.1 time: 0.038862 Aug 31 09:53:36.011663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 383/767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:35 2022] GET /compute/v2.1/servers/0150f767-f03e-4999-aaba-5ef9d302fa94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:53:36.019423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-43629fd1-5371-48d0-93c5-d7466f3a20d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '.version_select at 0x7f0b527e4550>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:36.039749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-43629fd1-5371-48d0-93c5-d7466f3a20d5 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669790544" status: 202 len: 0 microversion: 2.1 time: 0.024058 Aug 31 09:53:36.040373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 385/768] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 31 09:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669790544 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:53:36.867891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:36.868491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:36.875060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.875539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.875973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.876659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.877148 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.877569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.941832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:36.949545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2a042794-c89e-482d-8e1d-e7062cadb423 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1192 microversion: 2.1 time: 0.085562 Aug 31 09:53:36.950139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 384/769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:36 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:37.971373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:37.972361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:37.980578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.981404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.982097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:37.983811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.984502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.985443 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:38.144404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:38.152129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-014932f8-9682-4f62-b87a-1c18f40426e2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1276 microversion: 2.1 time: 0.185014 Aug 31 09:53:38.152713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 386/770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:37 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:38.486342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-78c7251d-953a-4b55-9e54-bd66b471287c req-d5624447-e494-4ed2-9741-1b4d4d2401a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680c3846-0a17-40b6-8be9-8e81e957b047", "tag": "5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:38.496149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-78c7251d-953a-4b55-9e54-bd66b471287c req-d5624447-e494-4ed2-9741-1b4d4d2401a5 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:38.496555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-78c7251d-953a-4b55-9e54-bd66b471287c req-d5624447-e494-4ed2-9741-1b4d4d2401a5 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:38.497661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-78c7251d-953a-4b55-9e54-bd66b471287c req-d5624447-e494-4ed2-9741-1b4d4d2401a5 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:38.515630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-78c7251d-953a-4b55-9e54-bd66b471287c req-d5624447-e494-4ed2-9741-1b4d4d2401a5 service nova] Creating event network-changed:5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3 for instance 680c3846-0a17-40b6-8be9-8e81e957b047 on hv-cinder-83754 Aug 31 09:53:38.520414 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-78c7251d-953a-4b55-9e54-bd66b471287c req-d5624447-e494-4ed2-9741-1b4d4d2401a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037764 Aug 31 09:53:38.521042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 385/771] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:38.969798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:38.970301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:38.976585 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:38.977295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:38.977563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:38.978276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:38.978735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:38.979164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.009269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:39.093359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-61ca0190-e2f6-4c89-8968-445290b5032a tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 204 len: 0 microversion: 2.1 time: 0.126885 Aug 31 09:53:39.094048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 387/772] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:38 2022] DELETE /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:53:39.102926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:39.103728 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:39.110769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.111705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.112322 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.113466 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.114131 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.114934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.177541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:39.178228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:39.184049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.186482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.186482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.186482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.187407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.187407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.252144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:39.259944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-76e55782-ec38-4405-a56c-9211b305453b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1508 microversion: 2.1 time: 0.161371 Aug 31 09:53:39.260804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 386/773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:39 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:39.320666 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:39.328314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5f4a49b4-001c-4c36-9043-6f5f0f953adc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.155061 Aug 31 09:53:39.328876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 388/774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:39 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:40.281018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:40.281649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:40.287954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.288429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.288856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.289562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.290010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.290428 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.348467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:40.349265 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:40.355606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.356135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.356574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.357293 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.357751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.358174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.425528 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:40.436574 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5b10fc48-d513-4e6f-8620-ba7089300fac tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1508 microversion: 2.1 time: 0.159642 Aug 31 09:53:40.437187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 387/775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:40 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:40.745627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:40.753864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-539dcebd-dc53-4ad7-bab5-3d915c4cd77c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.409218 Aug 31 09:53:40.754439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 389/776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:40 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:41.458704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.459324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.466555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.467045 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.467481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.468268 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.468848 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.469375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.625114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.632697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-88a787f8-afdd-4b46-a08e-530fece24357 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1508 microversion: 2.1 time: 0.178976 Aug 31 09:53:41.633300 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 388/777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:41.775207 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.775868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.782669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.783160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.783596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.784295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.784748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.785227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.978079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.986031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4eb461d3-10b9-4bd9-80ca-d459267e743e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.215369 Aug 31 09:53:41.986557 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 390/778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:42.198642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-85e994ae-ec72-4693-879c-890f456f1734 req-b3e160c4-5f39-448b-9f77-23bd0ee764c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9370735-2f4f-4598-97c7-d2cf483e6938", "name": "network-vif-deleted", "tag": "e6de08fc-180c-40b1-a1da-58f497731eef"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:42.208380 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-85e994ae-ec72-4693-879c-890f456f1734 req-b3e160c4-5f39-448b-9f77-23bd0ee764c3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.208857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-85e994ae-ec72-4693-879c-890f456f1734 req-b3e160c4-5f39-448b-9f77-23bd0ee764c3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.209343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-85e994ae-ec72-4693-879c-890f456f1734 req-b3e160c4-5f39-448b-9f77-23bd0ee764c3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.221490 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-85e994ae-ec72-4693-879c-890f456f1734 req-b3e160c4-5f39-448b-9f77-23bd0ee764c3 service nova] Creating event network-vif-deleted:e6de08fc-180c-40b1-a1da-58f497731eef for instance a9370735-2f4f-4598-97c7-d2cf483e6938 on hv-cinder-83754 Aug 31 09:53:42.227096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-85e994ae-ec72-4693-879c-890f456f1734 req-b3e160c4-5f39-448b-9f77-23bd0ee764c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032027 Aug 31 09:53:42.227717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 389/779] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:42.654286 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:42.654900 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:42.660906 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.661374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.661813 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.662507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.662963 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.663387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.694770 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.695258 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.695694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.696138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lazy-loading 'fault' on Instance uuid a9370735-2f4f-4598-97c7-d2cf483e6938 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:42.736128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:42.743713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6adbb93e-9661-4ccd-9889-831463a065ba tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 200 len: 1311 microversion: 2.1 time: 0.093437 Aug 31 09:53:42.744284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 391/780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:42 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:43.007782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:43.008678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:43.015315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.015851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.016285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.017010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.017484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.017898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.159043 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:43.166639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7e41be37-4b58-4d59-934e-72503ff077d1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.163736 Aug 31 09:53:43.167204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 390/781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:43 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:43.765078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:43.765694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: a9370735-2f4f-4598-97c7-d2cf483e6938] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:43.772128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.772621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.773090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.773784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.774245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.774678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.778696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:43.789065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] HTTP exception thrown: Instance a9370735-2f4f-4598-97c7-d2cf483e6938 could not be found. Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Request method failure captured: Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 HTTP/1.1 Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy38rhyCWbhrWtX4ZXPzZ8Svs_WJ0Ldq5jcu2O8coUQH-O-yM9_WeD23tE_uxwq-ZWZox_aBUTiH8Zqr5L57Exj0BpSGO-n4ysILMuW_bASeu2tUuEPRhY8FYvcPyz2tpUQ_eNzXwkJokzuCOEJ8VBvnoGfwLJdX9b2Bb9npRJqqkaI Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:53:43.790732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089a845bce2542969b7e6f013b28d928"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089a845bce2542969b7e6f013b28d928", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 79acdbc2c11c4459928eab5b83a6755d Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance a9370735-2f4f-4598-97c7-d2cf483e6938 could not be found. Aug 31 09:53:43.792313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'a9370735-2f4f-4598-97c7-d2cf483e6938'} Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9370735-2f4f-4598-97c7-d2cf483e6938 could not be found. Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:43.793228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9370735-2f4f-4598-97c7-d2cf483e6938 could not be found. Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9370735-2f4f-4598-97c7-d2cf483e6938 could not be found. Aug 31 09:53:43.795191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:43.796448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Returning 404 to user: Instance a9370735-2f4f-4598-97c7-d2cf483e6938 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:43.796448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0925e255-a5f7-4f46-9ae7-7def6763dffe tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938" status: 404 len: 111 microversion: 2.1 time: 0.031071 Aug 31 09:53:43.796448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 392/782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:43 2022] GET /compute/v2.1/servers/a9370735-2f4f-4598-97c7-d2cf483e6938 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:43.801138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:43.801632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:43.807434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.807912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.808340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.809611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.810064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.810486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.834659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:43.910796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-06b5415d-58e7-4717-a51a-b752cff5256f tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 204 len: 0 microversion: 2.1 time: 0.112881 Aug 31 09:53:43.911102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 391/783] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:43 2022] DELETE /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:43.919584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:43.920238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:43.928270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.928766 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.929225 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.929926 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.930381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.930804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.070047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:44.077882 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f33a433f-6fbf-4cf6-9750-2fda91e5b8a1 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.162759 Aug 31 09:53:44.078448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 393/784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:43 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:44.188110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:44.188801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:44.195225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.195708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.196140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.196821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.197334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.197757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.327760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:44.335376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d03da302-795e-466d-9bd1-a0656d1611d3 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.151728 Aug 31 09:53:44.335943 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 392/785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:44 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:45.099310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:45.099924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:45.106344 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.106832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.107366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.108063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.108522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.108949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.238788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.247543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9b40657d-b9b9-4fd4-9e7b-f49f1f685b89 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.152070 Aug 31 09:53:45.248113 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 394/786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:45 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:45.355617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:45.356157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:45.362682 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.363161 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.363592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.364276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.364739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.365187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.379686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:45.494830 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.502383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-152af6b6-0322-46bf-916d-4030cd0f651c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.150598 Aug 31 09:53:45.502943 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 393/787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:45 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:46.267630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:46.268283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:46.270257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:46.275812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.276301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.276737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.277462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.277921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.278346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.407705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:46.415270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a0feaeb5-d4c2-48f0-aa15-3972c7a9886b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.151520 Aug 31 09:53:46.415836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 395/788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:46 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:46.523616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:46.524190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:46.526109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:46.526759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:46.533229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.533717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.534159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.534852 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.535310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.535737 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.666420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:46.674545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eec26c06-59cc-4d32-912c-5b2b5060163c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.154892 Aug 31 09:53:46.675116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 394/789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:46 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:47.438001 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:47.438599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:47.444861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:47.445377 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:47.445814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:47.446499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:47.446954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:47.447376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:47.571903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.579489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-56b8f472-0e2a-41cb-97ff-7643d81c7ea6 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.146225 Aug 31 09:53:47.580057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 396/790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:47 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:47.694652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:47.695188 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:47.701440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:47.701915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:47.702341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:47.703017 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:47.703473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:47.703892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:47.832081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.839622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2eaf8b19-1f9d-4dad-b9fd-b0516925644d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.148863 Aug 31 09:53:47.840797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 395/791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:47 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:47.995936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:47.998348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.004292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.004780 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.005254 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.005947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.006404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.006830 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.035952 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1bcb884a-a82e-477e-9f0e-b3862bf11204 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043940 Aug 31 09:53:48.036498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 397/792] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:47 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:53:48.097290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.097791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.103703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.104185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.104621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.105349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.106448 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.106880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.132350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:48.205812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e91edb1e-52c7-48e2-b49f-6ab53329b383 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 204 len: 0 microversion: 2.1 time: 0.111994 Aug 31 09:53:48.206320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 396/793] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:48 2022] DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:48.214517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.215121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.221027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.221514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.221944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.222627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.223071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.223490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.356769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.364520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-845a62e5-af26-4f60-bcf4-ad0b2dfcc467 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1672 microversion: 2.1 time: 0.153882 Aug 31 09:53:48.365109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 398/794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:48.600451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.601090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.607383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.607859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.608282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.608976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.609427 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.609840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.742335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.749958 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9fb58c77-4a12-4b4e-a433-145703b0de26 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1523 microversion: 2.1 time: 0.153809 Aug 31 09:53:48.750527 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 397/795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:48.860291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.860796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.867210 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.867690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.868118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.868795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.869276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.869696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.001527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.009201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ea4712a1-f4cf-4675-9086-92e39a2be6ad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.153410 Aug 31 09:53:49.009787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 399/796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:49.386170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:49.386708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:49.393889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.394363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.394793 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.395486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.395934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.396355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.525685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.533819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-30bc3ad3-03fb-4298-85b4-4f6f20914187 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1672 microversion: 2.1 time: 0.151590 Aug 31 09:53:49.534393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 398/797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:49 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:49.722573 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-ef916f52-adef-419d-8b0a-78109428f2a8 req-a36ca307-2c0a-455d-b575-eb299d2c93cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3bc169-af8c-43fa-9d36-1dd91bfc54aa", "name": "network-vif-deleted", "tag": "b6e0ce8f-d9eb-4848-9b30-ae132fa4ce35"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:49.732452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ef916f52-adef-419d-8b0a-78109428f2a8 req-a36ca307-2c0a-455d-b575-eb299d2c93cb service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.732930 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ef916f52-adef-419d-8b0a-78109428f2a8 req-a36ca307-2c0a-455d-b575-eb299d2c93cb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.733384 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ef916f52-adef-419d-8b0a-78109428f2a8 req-a36ca307-2c0a-455d-b575-eb299d2c93cb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.744119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-ef916f52-adef-419d-8b0a-78109428f2a8 req-a36ca307-2c0a-455d-b575-eb299d2c93cb service nova] Creating event network-vif-deleted:b6e0ce8f-d9eb-4848-9b30-ae132fa4ce35 for instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa on hv-cinder-83754 Aug 31 09:53:49.749537 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-ef916f52-adef-419d-8b0a-78109428f2a8 req-a36ca307-2c0a-455d-b575-eb299d2c93cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030675 Aug 31 09:53:49.750127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 400/798] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:49.770909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:49.771526 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:49.777928 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.778419 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.778859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.779556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.780022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.780450 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.844489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79acdbc2c11c4459928eab5b83a6755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089a845bce2542969b7e6f013b28d928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.852338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eaabb935-6922-4c22-aa8a-62fe60a39b2b tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 200 len: 1481 microversion: 2.1 time: 0.085219 Aug 31 09:53:49.852913 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 399/799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:49 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 1481 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:50.036777 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:50.038141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:50.051142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.051974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.052597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.053349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.053987 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.054483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.305932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:50.313806 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-543a9cca-412d-4647-ace5-e4eed405055a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.287254 Aug 31 09:53:50.314647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 401/800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:50 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:50.554383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:50.554997 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:50.561407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.561897 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.562602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.563310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.563770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.564192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.712229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:50.721870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6980a2ce-f0ba-4601-a505-272742a457c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 200 len: 1672 microversion: 2.1 time: 0.171395 Aug 31 09:53:50.722641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 400/801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:50 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:50.876027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:50.876919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] [instance: 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:50.882774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.883270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.883709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.884417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.884874 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.885327 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.900911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] HTTP exception thrown: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa could not be found. Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Request method failure captured: Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa HTTP/1.1 Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy38rhyCWbhrWtX4ZXPzZ8Svs_WJ0Ldq5jcu2O8coUQH-O-yM9_WeD23tE_uxwq-ZWZox_aBUTiH8Zqr5L57Exj0BpSGO-n4ysILMuW_bASeu2tUuEPRhY8FYvcPyz2tpUQ_eNzXwkJokzuCOEJ8VBvnoGfwLJdX9b2Bb9npRJqqkaI Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:53:50.902594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089a845bce2542969b7e6f013b28d928"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089a845bce2542969b7e6f013b28d928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089a845bce2542969b7e6f013b28d928", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 089a845bce2542969b7e6f013b28d928 Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668906390 Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 79acdbc2c11c4459928eab5b83a6755d Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668906390-project Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa could not be found. Aug 31 09:53:50.904127 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '6f3bc169-af8c-43fa-9d36-1dd91bfc54aa'} Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa could not be found. Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:50.905313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa could not be found. Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa could not be found. Aug 31 09:53:50.907581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:50.909312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] Returning 404 to user: Instance 6f3bc169-af8c-43fa-9d36-1dd91bfc54aa could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:50.909312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b6fbc122-2a56-4d19-9b31-9c41a3660779 tempest-ServerRescueNegativeTestJSON-1668906390 tempest-ServerRescueNegativeTestJSON-1668906390-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa" status: 404 len: 111 microversion: 2.1 time: 0.034225 Aug 31 09:53:50.909312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 402/802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:50 2022] GET /compute/v2.1/servers/6f3bc169-af8c-43fa-9d36-1dd91bfc54aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:51.335708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:51.336318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:51.343855 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.344342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.344950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.345681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.346130 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.346718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.483858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:51.491553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-077c2a58-c077-4269-975c-63b8900517ff tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.160310 Aug 31 09:53:51.492348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 401/803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:51 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:51.744143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:51.745413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:51.759598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.760117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.760564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.762690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.763410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.764454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.771061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-3334d16e-47c4-40f4-b439-f92c168372c2 req-e8fdc410-6bf1-4ea0-912d-461a1929fc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0d2303-37de-40e0-b537-804a86067dee", "name": "network-vif-deleted", "tag": "f09361e0-942b-40ba-a8e3-5c45f1f23504"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:51.782987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3334d16e-47c4-40f4-b439-f92c168372c2 req-e8fdc410-6bf1-4ea0-912d-461a1929fc97 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.784810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3334d16e-47c4-40f4-b439-f92c168372c2 req-e8fdc410-6bf1-4ea0-912d-461a1929fc97 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.786493 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3334d16e-47c4-40f4-b439-f92c168372c2 req-e8fdc410-6bf1-4ea0-912d-461a1929fc97 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.811377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-3334d16e-47c4-40f4-b439-f92c168372c2 req-e8fdc410-6bf1-4ea0-912d-461a1929fc97 service nova] Creating event network-vif-deleted:f09361e0-942b-40ba-a8e3-5c45f1f23504 for instance 1e0d2303-37de-40e0-b537-804a86067dee on hv-cinder-83754 Aug 31 09:53:51.811878 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] HTTP exception thrown: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Request method failure captured: Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee HTTP/1.1 Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy3_ODl8v_IbKuJtiOi_wALzDIzJhsTi6BnRrGFLqrwL1ztam_mlWnQzhn3IAZ31IqOpsRfIrHwMk1m4q006w2ihslJNoKUU4l_cR4gcH6FvyQODhE80gejNUjFJiXiXzy5aZgvE2u7WfQDed9VJY49F7C1Mud14gcAhbJG433coCrA Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:53:51.813707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3fd1bef8389445f0a8cfe492cbf22f8c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: a0101b6f23d04016a89c986621ba5dde Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:53:51.815166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '1e0d2303-37de-40e0-b537-804a86067dee'} Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:51.815937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:53:51.817195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:51.818301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Returning 404 to user: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:51.821102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-342b5123-c5cc-4566-aa88-ba25110bb243 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 404 len: 111 microversion: 2.1 time: 0.081475 Aug 31 09:53:51.821735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 403/804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:51 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:51.825661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-3334d16e-47c4-40f4-b439-f92c168372c2 req-e8fdc410-6bf1-4ea0-912d-461a1929fc97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057142 Aug 31 09:53:51.826499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 402/805] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:51.830843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-471a8e72-e83e-4c5d-8483-4f609421eb80 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '.version_select at 0x7f0b5262e160>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:51.860609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-471a8e72-e83e-4c5d-8483-4f609421eb80 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661434089" status: 202 len: 0 microversion: 2.1 time: 0.025797 Aug 31 09:53:51.862998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 404/806] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 31 09:53:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661434089 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:53:51.910329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-dac7c63e-1113-4c32-98dc-de07fc0e06ce req-9d0e642b-4071-4c14-8b4f-87e3b6230763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680c3846-0a17-40b6-8be9-8e81e957b047", "name": "network-vif-plugged", "status": "completed", "tag": "5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:51.940345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-dac7c63e-1113-4c32-98dc-de07fc0e06ce req-9d0e642b-4071-4c14-8b4f-87e3b6230763 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.940836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-dac7c63e-1113-4c32-98dc-de07fc0e06ce req-9d0e642b-4071-4c14-8b4f-87e3b6230763 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.942816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-dac7c63e-1113-4c32-98dc-de07fc0e06ce req-9d0e642b-4071-4c14-8b4f-87e3b6230763 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.963733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-dac7c63e-1113-4c32-98dc-de07fc0e06ce req-9d0e642b-4071-4c14-8b4f-87e3b6230763 service nova] Creating event network-vif-plugged:5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3 for instance 680c3846-0a17-40b6-8be9-8e81e957b047 on hv-cinder-83754 Aug 31 09:53:51.977744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-dac7c63e-1113-4c32-98dc-de07fc0e06ce req-9d0e642b-4071-4c14-8b4f-87e3b6230763 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086420 Aug 31 09:53:51.978560 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 403/807] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:52.513673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:52.514348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:52.520188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.520674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.521150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.521840 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.522296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.522723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:53.060717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.069215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2004f7cf-8a27-4324-a1af-469cc3ccda18 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1264 microversion: 2.1 time: 0.560072 Aug 31 09:53:53.070470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 405/808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:52 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1264 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:53.376056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bae2fe08-b9af-4a31-8d84-795b5b4d1e86 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: .version_select at 0x7f0b528f4c10>, body: {"keypair": {"name": "tempest-keypair-574940677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV5iwGEnOJKWScbLPPab6brCIIvV47kgdZTm2xauFTgPOI9g5HGF0oGwS3G8KV8TN8e9U3+ORzVd5WNQSEISL9j07j9f+5LJuxp7uZNp7OmxpGqgPeZgKLzs2gG9D+X3Q=="}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:53.392368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-bae2fe08-b9af-4a31-8d84-795b5b4d1e86 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:53.396217 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-bae2fe08-b9af-4a31-8d84-795b5b4d1e86 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for user a0101b6f23d04016a89c986621ba5dde and project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:53.412068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:53.421089 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bae2fe08-b9af-4a31-8d84-795b5b4d1e86 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049616 Aug 31 09:53:53.421827 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 404/809] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:53:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:54.090039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:54.090420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:54.096842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.097374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.097807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.098500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.098949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.099366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.443971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.455188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-21a035d8-a45e-4207-bb66-bfa9a5f9b882 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1450 microversion: 2.1 time: 0.369130 Aug 31 09:53:54.456471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 406/810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:54 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1450 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:54.475725 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:54.476859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:54.486164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.486491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.486930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.487637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.488090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.488521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.722766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.731906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-03fbc912-c64e-43b5-89e9-7aeed519952c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1450 microversion: 2.1 time: 0.260066 Aug 31 09:53:54.732580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 405/811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:54 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1450 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:55.184934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1339638928", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4ac3a0a-2c56-408a-aeab-d333315fe587"}], "security_groups": [{"name": "tempest-securitygroup--1433888472"}], "key_name": "tempest-keypair-574940677", "user_data": "}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:55.330512 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] validate_networks() for [('d4ac3a0a-2c56-408a-aeab-d333315fe587', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:55.721219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:55.721896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:55.722448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:55.722798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:55.723211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:55.735918 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.736940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.736940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.737855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.738801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.739623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.760539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:55.764823 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Getting quotas for user a0101b6f23d04016a89c986621ba5dde and project 3fd1bef8389445f0a8cfe492cbf22f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:55.774179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:55.777296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:55.780050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:55.834733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-73c472b9-8fb6-4a71-8a32-f0959768cad5 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655963 Aug 31 09:53:55.836162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 407/812] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:53:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:53:55.852308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-248e0735-f76c-41de-b5a8-89600d5c27e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:55.853186 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-248e0735-f76c-41de-b5a8-89600d5c27e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:55.945010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-248e0735-f76c-41de-b5a8-89600d5c27e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.956350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-248e0735-f76c-41de-b5a8-89600d5c27e2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1237 microversion: 2.1 time: 0.112946 Aug 31 09:53:55.957320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 406/813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:55 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:56.977818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:56.978509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:56.988126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.988761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.989148 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.989871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.990335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.990762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.069300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:57.088562 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-476356c6-8b92-4471-9365-3a9cfcead93b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1289 microversion: 2.1 time: 0.114831 Aug 31 09:53:57.098290 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 408/814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:56 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:57.311029 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4daf42a4-f24d-40c5-9c22-dd03059c77d7 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Action: 'create', calling method: .version_select at 0x7f0b52821ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2086413603", "metadata": {"Type": "work"}}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4daf42a4-f24d-40c5-9c22-dd03059c77d7 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Request method failure captured: Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 122 Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy-1H5eMPh3Bc3Z6iXu32E_LeUcQQuNhFRCIx0kONr4SFViuMPRJhwQ7Y8sn9sK1wGhOTvNuwDuqfgInsjAeYyqQcG6KG4PIyhbMW_6fWpOgvf5cjJwgr6Dt2BqIuiN4JF0AgwhNFsOM-xRN0l7LqhZHm8CfzWZa3Ihc4OkLfH4jAsE Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:53:57.319865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b53fced7324bfe996e98857a4d3074", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: a5d58cd8d7794e279c1b4952072f7c8a Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2086413603", "metadata": {"Type": "work"}}} Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:53:57.321413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2086413603', 'metadata': {'Type': 'work'}}}} Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:57.322423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:53:57.324157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:53:57.325455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:53:57.325455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.325455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4daf42a4-f24d-40c5-9c22-dd03059c77d7 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:57.325455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4daf42a4-f24d-40c5-9c22-dd03059c77d7 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.190416 Aug 31 09:53:57.325455 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 407/815] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 31 09:53:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:53:57.334139 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-678b1098-6c58-48db-899e-45abbff608c4 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Action: 'create', calling method: .version_select at 0x7f0b527b0430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-279395946", "metadata": {"Type": "work"}}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-678b1098-6c58-48db-899e-45abbff608c4 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Request method failure captured: Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 119 Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy-1H5eMPh3Bc3Z6iXu32E_LeUcQQuNhFRCIx0kONr4SFViuMPRJhwQ7Y8sn9sK1wGhOTvNuwDuqfgInsjAeYyqQcG6KG4PIyhbMW_6fWpOgvf5cjJwgr6Dt2BqIuiN4JF0AgwhNFsOM-xRN0l7LqhZHm8CfzWZa3Ihc4OkLfH4jAsE Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:53:57.340836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b53fced7324bfe996e98857a4d3074", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: a5d58cd8d7794e279c1b4952072f7c8a Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-279395946", "metadata": {"Type": "work"}}} Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: Aug 31 09:53:57.342315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-279395946', 'metadata': {'Type': 'work'}}}} Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi '0' Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:57.343124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:53:57.344437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:53:57.345587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:53:57.345587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.345587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-678b1098-6c58-48db-899e-45abbff608c4 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:57.345587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-678b1098-6c58-48db-899e-45abbff608c4 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015104 Aug 31 09:53:57.345587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 409/816] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 31 09:53:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:53:57.355631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d5dc7f84-acc3-4f97-b4c0-f0cee36937ba tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Action: 'create', calling method: .version_select at 0x7f0b526c3700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2033725209", "metadata": {"Type": "work"}}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d5dc7f84-acc3-4f97-b4c0-f0cee36937ba tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Request method failure captured: Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 119 Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy-1H5eMPh3Bc3Z6iXu32E_LeUcQQuNhFRCIx0kONr4SFViuMPRJhwQ7Y8sn9sK1wGhOTvNuwDuqfgInsjAeYyqQcG6KG4PIyhbMW_6fWpOgvf5cjJwgr6Dt2BqIuiN4JF0AgwhNFsOM-xRN0l7LqhZHm8CfzWZa3Ihc4OkLfH4jAsE Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:53:57.359625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b53fced7324bfe996e98857a4d3074", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: a5d58cd8d7794e279c1b4952072f7c8a Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2033725209", "metadata": {"Type": "work"}}} Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:53:57.360918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2033725209', 'metadata': {'Type': 'work'}}}} Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi '' Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:57.361766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:53:57.363128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:53:57.364691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:53:57.364691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.364691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d5dc7f84-acc3-4f97-b4c0-f0cee36937ba tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:57.364691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d5dc7f84-acc3-4f97-b4c0-f0cee36937ba tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010487 Aug 31 09:53:57.366384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 408/817] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 31 09:53:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:53:57.376339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fcd8aa6-cf58-42d1-9851-db442364003b tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Calling method '.version_select at 0x7f0b525f0e50>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:57.414528 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-5fcd8aa6-cf58-42d1-9851-db442364003b tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] HTTP exception thrown: Volume tempest-invalid-237587832 could not be found. Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fcd8aa6-cf58-42d1-9851-db442364003b tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Request method failure captured: Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-237587832 HTTP/1.1 Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy-1H5eMPh3Bc3Z6iXu32E_LeUcQQuNhFRCIx0kONr4SFViuMPRJhwQ7Y8sn9sK1wGhOTvNuwDuqfgInsjAeYyqQcG6KG4PIyhbMW_6fWpOgvf5cjJwgr6Dt2BqIuiN4JF0AgwhNFsOM-xRN0l7LqhZHm8CfzWZa3Ihc4OkLfH4jAsE Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:53:57.418634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b53fced7324bfe996e98857a4d3074", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: a5d58cd8d7794e279c1b4952072f7c8a Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Volume tempest-invalid-237587832 could not be found. Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'tempest-invalid-237587832'} Aug 31 09:53:57.419967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-237587832 could not be found. (HTTP 404) (Request-ID: req-e9417033-5489-4d63-bdcc-ba94633694cd) Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.425280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:53:57.426891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-237587832 could not be found. Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:57.428152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-237587832 could not be found. Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-237587832 could not be found. Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fcd8aa6-cf58-42d1-9851-db442364003b tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Returning 404 to user: Volume tempest-invalid-237587832 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5fcd8aa6-cf58-42d1-9851-db442364003b tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-237587832" status: 404 len: 98 microversion: 2.1 time: 0.051052 Aug 31 09:53:57.430306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 410/818] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Aug 31 09:53:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-237587832 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:53:57.434994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b735ce60-9712-496f-9920-c61f0932f422 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003891 Aug 31 09:53:57.434994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 409/819] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Aug 31 09:53:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 09:53:57.440047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6aed8e15-866d-420d-985e-54dd3d2bf1f1 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004148 Aug 31 09:53:57.440560 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 411/820] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Aug 31 09:53:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 09:53:57.450454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7940132e-9e89-4e2b-8687-b5df8fc652d8 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Calling method '.version_select at 0x7f0b526e18b0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:57.464788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-c9730dab-d7fb-495f-b13d-29746a9e009a req-a2a4dd95-1f51-4dc7-967d-07bad2f7fc90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680c3846-0a17-40b6-8be9-8e81e957b047", "tag": "5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:57.481193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c9730dab-d7fb-495f-b13d-29746a9e009a req-a2a4dd95-1f51-4dc7-967d-07bad2f7fc90 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.482784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c9730dab-d7fb-495f-b13d-29746a9e009a req-a2a4dd95-1f51-4dc7-967d-07bad2f7fc90 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.483222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-c9730dab-d7fb-495f-b13d-29746a9e009a req-a2a4dd95-1f51-4dc7-967d-07bad2f7fc90 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.483519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-7940132e-9e89-4e2b-8687-b5df8fc652d8 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] HTTP exception thrown: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7940132e-9e89-4e2b-8687-b5df8fc652d8 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Request method failure captured: Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: DELETE /compute/v2.1/os-volumes/babb5186-bc71-45c2-87b5-9efe87a93349 HTTP/1.1 Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy-1H5eMPh3Bc3Z6iXu32E_LeUcQQuNhFRCIx0kONr4SFViuMPRJhwQ7Y8sn9sK1wGhOTvNuwDuqfgInsjAeYyqQcG6KG4PIyhbMW_6fWpOgvf5cjJwgr6Dt2BqIuiN4JF0AgwhNFsOM-xRN0l7LqhZHm8CfzWZa3Ihc4OkLfH4jAsE Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:53:57.487914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b53fced7324bfe996e98857a4d3074", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: a5d58cd8d7794e279c1b4952072f7c8a Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'babb5186-bc71-45c2-87b5-9efe87a93349'} Aug 31 09:53:57.489370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. (HTTP 404) (Request-ID: req-7e848b45-f40e-4742-abf4-6903d7d6d05b) Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.490232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:53:57.491405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:53:57.492519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7940132e-9e89-4e2b-8687-b5df8fc652d8 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Returning 404 to user: Volume babb5186-bc71-45c2-87b5-9efe87a93349 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7940132e-9e89-4e2b-8687-b5df8fc652d8 tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/babb5186-bc71-45c2-87b5-9efe87a93349" status: 404 len: 109 microversion: 2.1 time: 0.043377 Aug 31 09:53:57.499730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 410/821] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:53:57 2022] DELETE /compute/v2.1/os-volumes/babb5186-bc71-45c2-87b5-9efe87a93349 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:53:57.503386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4a9963c2-7f8e-45e9-8505-028d2000287e tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Calling method '.version_select at 0x7f0b5267d280>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:57.506140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-c9730dab-d7fb-495f-b13d-29746a9e009a req-a2a4dd95-1f51-4dc7-967d-07bad2f7fc90 service nova] Creating event network-changed:5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3 for instance 680c3846-0a17-40b6-8be9-8e81e957b047 on hv-cinder-83754 Aug 31 09:53:57.512738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-c9730dab-d7fb-495f-b13d-29746a9e009a req-a2a4dd95-1f51-4dc7-967d-07bad2f7fc90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051002 Aug 31 09:53:57.513852 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 412/822] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:57.536050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-4a9963c2-7f8e-45e9-8505-028d2000287e tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] HTTP exception thrown: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4a9963c2-7f8e-45e9-8505-028d2000287e tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Request method failure captured: Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/os-volumes/17cc40d6-d5a1-4e91-9c96-2b7a074c661c HTTP/1.1 Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy-1H5eMPh3Bc3Z6iXu32E_LeUcQQuNhFRCIx0kONr4SFViuMPRJhwQ7Y8sn9sK1wGhOTvNuwDuqfgInsjAeYyqQcG6KG4PIyhbMW_6fWpOgvf5cjJwgr6Dt2BqIuiN4JF0AgwhNFsOM-xRN0l7LqhZHm8CfzWZa3Ihc4OkLfH4jAsE Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:53:57.538182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b53fced7324bfe996e98857a4d3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b53fced7324bfe996e98857a4d3074", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 67b53fced7324bfe996e98857a4d3074 Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesNegativeTest-197764181 Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: a5d58cd8d7794e279c1b4952072f7c8a Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesNegativeTest-197764181-project Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '17cc40d6-d5a1-4e91-9c96-2b7a074c661c'} Aug 31 09:53:57.539606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. (HTTP 404) (Request-ID: req-d1532072-170d-4703-9a45-c15bb749e3b4) Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.540413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:53:57.542372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:53:57.545922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4a9963c2-7f8e-45e9-8505-028d2000287e tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] Returning 404 to user: Volume 17cc40d6-d5a1-4e91-9c96-2b7a074c661c could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4a9963c2-7f8e-45e9-8505-028d2000287e tempest-VolumesNegativeTest-197764181 tempest-VolumesNegativeTest-197764181-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/17cc40d6-d5a1-4e91-9c96-2b7a074c661c" status: 404 len: 109 microversion: 2.1 time: 0.039999 Aug 31 09:53:57.548475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 411/823] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:53:57 2022] GET /compute/v2.1/os-volumes/17cc40d6-d5a1-4e91-9c96-2b7a074c661c => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:58.119291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:58.119985 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:58.131019 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.133748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.134441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.135355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.135977 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.137084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.472299 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:58.480278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-470e19f4-d257-4f86-8d4e-c1b7cf79d536 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.364981 Aug 31 09:53:58.481158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 413/824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:58 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:59.038058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-9b3e62dc-be51-4d0c-ade1-3d078991d77a req-9e5c4b2a-65ba-42b4-b92b-1fd34da9188a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb255dd-7ee8-454c-8721-7be99943aa42", "tag": "4be9c7d2-800c-4781-97d3-dea4d43bba78"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:59.052379 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-9b3e62dc-be51-4d0c-ade1-3d078991d77a req-9e5c4b2a-65ba-42b4-b92b-1fd34da9188a service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.053341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-9b3e62dc-be51-4d0c-ade1-3d078991d77a req-9e5c4b2a-65ba-42b4-b92b-1fd34da9188a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.054407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-9b3e62dc-be51-4d0c-ade1-3d078991d77a req-9e5c4b2a-65ba-42b4-b92b-1fd34da9188a service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.067468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-9b3e62dc-be51-4d0c-ade1-3d078991d77a req-9e5c4b2a-65ba-42b4-b92b-1fd34da9188a service nova] Creating event network-changed:4be9c7d2-800c-4781-97d3-dea4d43bba78 for instance 8eb255dd-7ee8-454c-8721-7be99943aa42 on hv-cinder-83754 Aug 31 09:53:59.072516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-9b3e62dc-be51-4d0c-ade1-3d078991d77a req-9e5c4b2a-65ba-42b4-b92b-1fd34da9188a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039595 Aug 31 09:53:59.073440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 412/825] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:59.502891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:59.503513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:59.510340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.510841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.511276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.511979 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.512438 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.512866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.728907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:59.739095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-52601c35-c68f-41a2-8ce7-dba88eda8352 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.241010 Aug 31 09:53:59.739815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 414/826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:59 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:00.760302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:00.761021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:00.767767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.768256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.768692 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.769403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.769860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.770283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.896704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:00.904566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f8239f40-3f58-4916-8f8d-28f3f30baab1 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.148651 Aug 31 09:54:00.905172 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 413/827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:00 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:01.925531 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:01.926146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:01.932904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.933963 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.934437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:01.935172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.935884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.936343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:02.067091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:02.076357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b7c66df2-d9c4-48ca-9652-c7eb4b96b392 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.154720 Aug 31 09:54:02.076938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 415/828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:01 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:03.097244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:03.097860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:03.104308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.104842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.105840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.106535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.106995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.107422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.236084 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:03.243688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-505632a2-6f9e-4ef2-af3d-6e58118f61fb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.150376 Aug 31 09:54:03.244257 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 414/829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:03 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:04.264829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:04.265491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:04.271942 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.272432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.272873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.273593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.274053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.274516 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.404614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:04.406950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:04.413660 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0d91e085-ed1f-4d6a-9a33-9f2b27adce60 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.153253 Aug 31 09:54:04.414237 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 416/830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:04 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:05.435392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:05.436263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:05.442777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.443261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.443697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.444389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.444846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.445304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.576478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:05.585384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-80d048aa-87b9-49a2-9931-644d2a089d16 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.154022 Aug 31 09:54:05.585975 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 415/831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:05 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:06.605909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:06.606549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:06.608862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:06.609606 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:06.616833 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.617351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.617789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.618488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.618945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.619374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.750061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:06.757642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-20fb517a-c5f5-46c5-b54d-0331e8249866 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.156256 Aug 31 09:54:06.758226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 417/832] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:06 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:07.778665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:07.779367 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:07.784287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:07.786728 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.787209 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.787637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.788332 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.792470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.792936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.931937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:07.940759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e12b34ae-9d1d-4533-a880-8c807915b630 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.166026 Aug 31 09:54:07.941398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 416/833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:07 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:08.962343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:08.963040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:08.970244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.970734 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.971172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.971866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.972353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.972778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.106442 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:09.114162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-006a8eb9-0bd4-46f2-998f-5010cea68a8a tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.155709 Aug 31 09:54:09.114739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 418/834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:08 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:09.295385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-8bed1751-a644-4d1c-8fe3-4bac23eda0bf req-7c3bbc89-e4ae-4d16-aa00-7556fac6095b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb255dd-7ee8-454c-8721-7be99943aa42", "name": "network-vif-plugged", "status": "completed", "tag": "4be9c7d2-800c-4781-97d3-dea4d43bba78"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:09.309498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-8bed1751-a644-4d1c-8fe3-4bac23eda0bf req-7c3bbc89-e4ae-4d16-aa00-7556fac6095b service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.309988 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-8bed1751-a644-4d1c-8fe3-4bac23eda0bf req-7c3bbc89-e4ae-4d16-aa00-7556fac6095b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.310667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-8bed1751-a644-4d1c-8fe3-4bac23eda0bf req-7c3bbc89-e4ae-4d16-aa00-7556fac6095b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.323069 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-8bed1751-a644-4d1c-8fe3-4bac23eda0bf req-7c3bbc89-e4ae-4d16-aa00-7556fac6095b service nova] Creating event network-vif-plugged:4be9c7d2-800c-4781-97d3-dea4d43bba78 for instance 8eb255dd-7ee8-454c-8721-7be99943aa42 on hv-cinder-83754 Aug 31 09:54:09.328653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-8bed1751-a644-4d1c-8fe3-4bac23eda0bf req-7c3bbc89-e4ae-4d16-aa00-7556fac6095b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037006 Aug 31 09:54:09.329360 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 417/835] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:10.134144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:10.134689 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:10.141279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.141765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.142198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.142886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.143341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.143766 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.273694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:10.281695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-054d5d44-b199-4a10-8da7-f4bc38b5b417 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.151361 Aug 31 09:54:10.282272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 419/836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:10 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:11.303190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:11.303895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:11.314916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.315404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.315839 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.316536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.317041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.317470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.321661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:11.457323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:11.465859 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c292555e-b191-44f2-89a6-6149282cd6cf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1363 microversion: 2.1 time: 0.167258 Aug 31 09:54:11.466479 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 418/837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:11 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:12.486288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:12.486902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:12.493577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:12.494110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:12.494552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:12.495266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:12.495725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:12.496154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:12.636429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:12.643933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f537d0bb-71ab-4228-81cd-f2e46588eeaf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1549 microversion: 2.1 time: 0.161555 Aug 31 09:54:12.644492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 420/838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:12 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:12.664347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:12.664840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:12.671167 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:12.671657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:12.672091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:12.672780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:12.673271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:12.673703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:12.752768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-152b5727-ee89-40f6-a0c2-5c546f29f2bf tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092240 Aug 31 09:54:12.753415 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 419/839] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:54:12 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:13.709464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-0f670416-7069-4d1e-ba75-0150b379939e req-d937821b-1772-4fd0-aadb-bcf9bf0787ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb255dd-7ee8-454c-8721-7be99943aa42", "tag": "4be9c7d2-800c-4781-97d3-dea4d43bba78"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:13.721041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-0f670416-7069-4d1e-ba75-0150b379939e req-d937821b-1772-4fd0-aadb-bcf9bf0787ef service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:13.721744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-0f670416-7069-4d1e-ba75-0150b379939e req-d937821b-1772-4fd0-aadb-bcf9bf0787ef service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:13.722177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-0f670416-7069-4d1e-ba75-0150b379939e req-d937821b-1772-4fd0-aadb-bcf9bf0787ef service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:13.733965 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-0f670416-7069-4d1e-ba75-0150b379939e req-d937821b-1772-4fd0-aadb-bcf9bf0787ef service nova] Creating event network-changed:4be9c7d2-800c-4781-97d3-dea4d43bba78 for instance 8eb255dd-7ee8-454c-8721-7be99943aa42 on hv-cinder-83754 Aug 31 09:54:13.739491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-0f670416-7069-4d1e-ba75-0150b379939e req-d937821b-1772-4fd0-aadb-bcf9bf0787ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 Aug 31 09:54:13.740099 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 421/840] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:12.934632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=22 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:12.935471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=9 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:12.942253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:12.942754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:12.953595 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.954115 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.954687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.955393 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.955849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.956591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.984497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c11c2814-976a-497c-a180-bd3a88657b2a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/ips" status: 200 len: 149 microversion: 2.1 time: 0.052113 Aug 31 09:55:12.991263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 420/841] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:55:12 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:15.401456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:15.402665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=27 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:15.408250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bdf99c3-2ce5-4063-b799-ad6be2ede039"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:15.410935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:15.419396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:15.419886 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:15.420320 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:15.421047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:15.421503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:15.421936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:15.700590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2ace8087-5fb9-4ac9-9cbf-9b1537017ac4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301500 Aug 31 09:55:15.701263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 422/842] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:55:15 2022] POST /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:16.636047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:16.636625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:16.643000 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:16.643486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:16.643951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:16.644642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:16.645124 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:16.645550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:16.667847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cd79b992-03e0-440b-ac3b-3a14287113da tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/ips" status: 200 len: 152 microversion: 2.20 time: 0.036216 Aug 31 09:55:16.668341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 421/843] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Aug 31 09:55:16 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:55:21.641775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:21.642393 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:21.649217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.649696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.650129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:21.650812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.651261 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.651678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:21.675033 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lazy-loading 'flavor' on Instance uuid af107e2b-f03b-4aff-ad71-c4f20b8f5f35 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:21.859362 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-be24fb95-eb9f-48ac-b1b0-d4f811e6ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/action" status: 202 len: 0 microversion: 2.20 time: 0.222279 Aug 31 09:55:21.859898 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 423/844] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 31 09:55:21 2022] POST /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:21.868296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:21.869093 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:21.875942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.876437 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.877049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:21.877782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.878551 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.879011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:22.010809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.018958 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.020395 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.022073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0ceaddcd-2e99-4ff1-8bf1-386da9f01acd tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.157746 Aug 31 09:55:22.023386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 422/845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:21 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:23.046396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:23.047103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:23.054082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.054576 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.055016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.055718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.056179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.056609 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.193050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:23.202060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:23.203604 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:23.204794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-38b2598c-b3df-483c-b52d-081633ed6d10 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.163370 Aug 31 09:55:23.205416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 424/846] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:23 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:24.227693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:24.228298 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:24.234717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.235196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.235623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.236306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.236756 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.237200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.368400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:24.376350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:24.377842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:24.378995 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bd79f307-1186-4c05-bdd9-73f8f3b0aaed tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.155822 Aug 31 09:55:24.379547 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 423/847] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:24 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:25.402071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:25.402687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:25.409303 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.409793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.410232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.410922 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.411384 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.411813 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.540501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:25.548487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:25.549953 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:25.551110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-60ff9a5f-fe29-46bb-b339-dda2e98fd82c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.152951 Aug 31 09:55:25.551672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 425/848] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:25 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:26.574844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:26.575454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:26.582085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:26.582573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:26.583010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.583700 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:26.584159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:26.584635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.710386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.718409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.719857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.721049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4681e327-2668-4483-813b-8593008620bb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.150146 Aug 31 09:55:26.721615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 424/849] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:26 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:27.743773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:27.744312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:27.750759 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.751250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.751682 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.752365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.752816 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.753265 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.879583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.887688 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.889168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.890323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f854594d-3831-4908-881f-6bb8be1b9e5d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.150707 Aug 31 09:55:27.890880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 426/850] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:27 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:28.613615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bdf99c3-2ce5-4063-b799-ad6be2ede039"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:28.616555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.622819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.623306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.623740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.624431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.624889 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.625347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.702384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Invalid volume: volume 0bdf99c3-2ce5-4063-b799-ad6be2ede039 is already attached to instances: d701452f-8a93-4c9c-8225-7a2d1747290e Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: POST /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments HTTP/1.1 Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 74 Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:55:28.704112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {"volumeAttachment": {"volumeId": "0bdf99c3-2ce5-4063-b799-ad6be2ede039"}} Aug 31 09:55:28.705730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Invalid volume: volume 0bdf99c3-2ce5-4063-b799-ad6be2ede039 is already attached to instances: d701452f-8a93-4c9c-8225-7a2d1747290e Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'server_id': 'd701452f-8a93-4c9c-8225-7a2d1747290e', 'body': {'volumeAttachment': {'volumeId': '0bdf99c3-2ce5-4063-b799-ad6be2ede039'}}} Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0bdf99c3-2ce5-4063-b799-ad6be2ede039 is already attached to instances: d701452f-8a93-4c9c-8225-7a2d1747290e Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:55:28.706519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0bdf99c3-2ce5-4063-b799-ad6be2ede039 is already attached to instances: d701452f-8a93-4c9c-8225-7a2d1747290e Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:28.707969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0bdf99c3-2ce5-4063-b799-ad6be2ede039 is already attached to instances: d701452f-8a93-4c9c-8225-7a2d1747290e Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 400 to user: Invalid volume: volume 0bdf99c3-2ce5-4063-b799-ad6be2ede039 is already attached to instances: d701452f-8a93-4c9c-8225-7a2d1747290e {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-16168314-4b66-4642-a16a-a7cdabdb9c3b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095971 Aug 31 09:55:28.709521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 425/851] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:55:28 2022] POST /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:55:28.771339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:28.771863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.778273 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.778754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.779186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.779869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.780316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.780734 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.863239 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'services' on Instance uuid d701452f-8a93-4c9c-8225-7a2d1747290e {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:28.914203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:28.914849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.922294 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.922869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.923309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.924025 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.924488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.925007 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.936873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5559da94-10a8-4668-9cca-e3af734423a2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments/0bdf99c3-2ce5-4063-b799-ad6be2ede039" status: 202 len: 0 microversion: 2.1 time: 0.169195 Aug 31 09:55:28.937684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 427/852] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:55:28 2022] DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments/0bdf99c3-2ce5-4063-b799-ad6be2ede039 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:55:28.947639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:28.950162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.957677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.958164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.958768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.959502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.959972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.960395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.993179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-cd8017ae-72f6-487c-b743-ded2b2a44af8 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050108 Aug 31 09:55:28.993761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 428/853] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:28 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:29.060673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:29.069111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:29.070627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:29.071824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b7288443-423a-44c1-b944-13a4399d83ef tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.162011 Aug 31 09:55:29.072374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 426/854] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:28 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:30.007410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:30.009676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:30.015980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.016460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.016912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.018177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.018803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.019242 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.049202 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9578d548-7e5b-4731-8316-89f8d79702c5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047456 Aug 31 09:55:30.049769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 429/855] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:30 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:55:30.094902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:30.095688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:30.102448 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.102934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.103385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.104090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.104533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.104971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.114292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:30.114797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:30.121455 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.122096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.122531 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.123398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.123764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.124191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.150334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:30.229602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-72ef73bb-e13b-4256-af13-1640da9d6ea0 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 204 len: 0 microversion: 2.1 time: 0.118522 Aug 31 09:55:30.230115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 430/856] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:30 2022] DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:55:30.239414 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:30.240287 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:30.243921 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.246130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.246633 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.247045 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.247851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.248305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.248737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.252239 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.253725 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.254887 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-00de251f-7b49-4bf1-a230-d1187e8606fe tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.164343 Aug 31 09:55:30.255444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 427/857] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:30 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:30.377907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.386122 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a61a54ee-0c18-4bd9-86ac-833f18f3dadc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1680 microversion: 2.1 time: 0.151670 Aug 31 09:55:30.386687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 431/858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:30 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:31.278989 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:31.279593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:31.285472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.285946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.286374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.287082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.287531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.287947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.407592 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:31.408186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:31.413038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.414582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.415067 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.415495 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.416184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.416634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.417077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.421021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.422445 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.423600 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f5556515-1ea3-4b77-8c75-56ba0156ed11 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.148653 Aug 31 09:55:31.424139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 428/859] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:31 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:31.544150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.547676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:31.552596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8a9fbdc7-6b81-4994-80ed-3a4e64cecc8d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1680 microversion: 2.1 time: 0.148877 Aug 31 09:55:31.553758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 432/860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:31 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:32.447632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:32.448226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:32.454612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.455100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.455536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.456223 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.456683 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.457151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.575888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:32.576671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:32.585219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.585842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.586575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.587345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.587851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.588321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.617659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:32.626494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:32.627940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:32.629155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b7c628bc-70cb-4516-908b-c416c1548ca9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.185429 Aug 31 09:55:32.629723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 429/861] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:32 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:32.817434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:32.825693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3eed05be-e0d4-4190-97f8-2d03819a5951 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1680 microversion: 2.1 time: 0.254375 Aug 31 09:55:32.826260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 433/862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:32 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:33.652293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:33.652909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:33.661120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.661869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.663057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.664272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.664902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.665543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.713797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-59cf2be5-5756-4c1c-9520-74327d090e97 req-3cb84431-1fdb-4e45-91e9-2aee2a30d7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d701452f-8a93-4c9c-8225-7a2d1747290e", "name": "network-vif-deleted", "tag": "8c0cc885-7067-472e-aa12-db0e5b516da1"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:33.724493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-59cf2be5-5756-4c1c-9520-74327d090e97 req-3cb84431-1fdb-4e45-91e9-2aee2a30d7d2 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.725836 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-59cf2be5-5756-4c1c-9520-74327d090e97 req-3cb84431-1fdb-4e45-91e9-2aee2a30d7d2 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.726274 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-59cf2be5-5756-4c1c-9520-74327d090e97 req-3cb84431-1fdb-4e45-91e9-2aee2a30d7d2 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.738054 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-59cf2be5-5756-4c1c-9520-74327d090e97 req-3cb84431-1fdb-4e45-91e9-2aee2a30d7d2 service nova] Creating event network-vif-deleted:8c0cc885-7067-472e-aa12-db0e5b516da1 for instance d701452f-8a93-4c9c-8225-7a2d1747290e on hv-cinder-83754 Aug 31 09:55:33.743595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-59cf2be5-5756-4c1c-9520-74327d090e97 req-3cb84431-1fdb-4e45-91e9-2aee2a30d7d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Aug 31 09:55:33.744694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 434/863] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:33.823432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.832299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.833816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.835539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-44182b05-2ab5-4d23-ae5b-1c661842ec48 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.187140 Aug 31 09:55:33.836131 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 430/864] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:33 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:33.847091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:33.847801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:33.854289 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.854780 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.855219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.855919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.856377 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.856909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.892455 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.893105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.893602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.894198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'fault' on Instance uuid d701452f-8a93-4c9c-8225-7a2d1747290e {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:33.937102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.951891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9bb32f74-9a56-4d49-a4f0-04d358857e82 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 200 len: 1331 microversion: 2.1 time: 0.108891 Aug 31 09:55:33.952503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 435/865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:33 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:34.859160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:34.859709 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:34.866762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.867236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.867661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.868338 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.868802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.869238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.974027 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:34.975213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:34.981464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.981941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.982369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.983053 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.983499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.983917 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.995939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:34.997718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e HTTP/1.1 Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:55:34.999345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:55:35.001030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'd701452f-8a93-4c9c-8225-7a2d1747290e'} Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:35.001948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:55:35.003456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:55:35.004838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:35.004838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-38906416-4291-48e6-9d24-5daf7e5ea46f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 404 len: 111 microversion: 2.1 time: 0.030563 Aug 31 09:55:35.004838 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 436/866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:34 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:55:35.007716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:35.009181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1c6509a3-5247-41e4-af24-9b79635a82ea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '.version_select at 0x7f0b56062700>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:35.009378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:35.010656 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ec1ddfbd-7987-489c-a4d7-6451af7a8232 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.155464 Aug 31 09:55:35.011275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 431/867] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:34 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:35.026832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1c6509a3-5247-41e4-af24-9b79635a82ea tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485556790" status: 202 len: 0 microversion: 2.1 time: 0.021116 Aug 31 09:55:35.027376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 437/868] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 31 09:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485556790 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:55:35.638482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8def8fe9-6458-487c-b205-5faebfc6250a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: .version_select at 0x7f0b525adf70>, body: {"keypair": {"name": "tempest-keypair-589254390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqAPbwyqGnh3dcZTWKq2XbywM+XsrzAo+pFnwdBZSN4vxWBY81HYBANz3K5mM9iqqXNgUOBi+icp0G7dxCZ3UbL9fP4jP0I4AdKn+JSXTXEz8BDH0TzcWJHPgrvffgNrw=="}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:35.654072 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-8def8fe9-6458-487c-b205-5faebfc6250a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:55:35.657876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-8def8fe9-6458-487c-b205-5faebfc6250a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:55:35.679441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8def8fe9-6458-487c-b205-5faebfc6250a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044869 Aug 31 09:55:35.680018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 432/869] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:55:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:36.034543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:36.035149 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:36.042065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:36.042554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:36.042990 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:36.043680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:36.044135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:36.044556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:36.181161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:36.189934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:36.191381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:36.192556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6818805a-0169-46a5-b30d-2414c33be810 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.162561 Aug 31 09:55:36.193155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 438/870] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:36 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:37.163128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-402467775", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e"}], "security_groups": [{"name": "tempest-securitygroup--1475621523"}], "key_name": "tempest-keypair-589254390", "user_data": "}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:37.215564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:37.216115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:37.222582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.223088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.223511 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.224903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.225391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.225815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.272750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] validate_networks() for [('4b6d2520-ca00-45ac-9b4b-f6bfa9e50f0e', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:55:37.360499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.368923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.370378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.371546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4d9c0029-7d0b-48cd-be02-33cd83da87c0 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.159942 Aug 31 09:55:37.372108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 439/871] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:37 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:37.640182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:55:37.640631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:55:37.641141 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:55:37.641552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:55:37.641963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:55:37.651030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.651509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.651942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.652665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.653160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.653581 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.670467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:55:37.674530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Getting quotas for user 0fca332203b9473fa8b07286bc44300f and project 1e3cef1ca6964f3dbae8e170ff530811. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:55:37.685572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:55:37.687826 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:55:37.735118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7541d570-bbac-4322-961b-7565eba8946f tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.576814 Aug 31 09:55:37.735764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 433/872] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:55:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:55:37.746626 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-94e615a0-d746-4b5a-a8af-22271e49a260 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:37.747327 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-94e615a0-d746-4b5a-a8af-22271e49a260 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:37.804312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-94e615a0-d746-4b5a-a8af-22271e49a260 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.811421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-94e615a0-d746-4b5a-a8af-22271e49a260 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1240 microversion: 2.1 time: 0.068651 Aug 31 09:55:37.812170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 440/873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:37 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:38.396073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.396853 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.403248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.403735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.404197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.405022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.405720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.406369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.543081 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.551025 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.552470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.554230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c89a7251-1fa8-4be9-81b1-3a7260eec072 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.163571 Aug 31 09:55:38.554776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 434/874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:38.831582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.832193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.838737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.839221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.839650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.840330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.840802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.841246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.905278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.914007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5e5aba9c-9269-4870-8861-122db4170f13 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1292 microversion: 2.1 time: 0.086184 Aug 31 09:55:38.914590 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 441/875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:39.577625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:39.578237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:39.586841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.587333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.587950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:39.588839 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.589335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.589760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:39.738727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:39.750392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:39.751869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:39.753564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-aa3b36cc-4918-4410-b12b-09e906449d20 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.179868 Aug 31 09:55:39.768152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 435/876] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:39 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:39.935541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:39.936829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:39.945397 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.945565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.946003 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:39.946868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.947161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.947578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.193803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:40.202284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-63a38d92-30de-4603-b263-1e4b8da757bf tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.271166 Aug 31 09:55:40.202875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 442/877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:39 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:40.571761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-7d0524c6-68fb-458f-8df8-1acef8742a99 req-424e3407-fe2f-4043-94f0-8f4fbcac8cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b45063-183f-4c0a-9871-d8cde6966af8", "tag": "6186ef2b-dc26-47e8-9e55-45549f6ca4ad"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:40.582633 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-7d0524c6-68fb-458f-8df8-1acef8742a99 req-424e3407-fe2f-4043-94f0-8f4fbcac8cf3 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.583396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-7d0524c6-68fb-458f-8df8-1acef8742a99 req-424e3407-fe2f-4043-94f0-8f4fbcac8cf3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.584590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-7d0524c6-68fb-458f-8df8-1acef8742a99 req-424e3407-fe2f-4043-94f0-8f4fbcac8cf3 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.595652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-7d0524c6-68fb-458f-8df8-1acef8742a99 req-424e3407-fe2f-4043-94f0-8f4fbcac8cf3 service nova] Creating event network-changed:6186ef2b-dc26-47e8-9e55-45549f6ca4ad for instance 46b45063-183f-4c0a-9871-d8cde6966af8 on hv-cinder-83754 Aug 31 09:55:40.601087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-7d0524c6-68fb-458f-8df8-1acef8742a99 req-424e3407-fe2f-4043-94f0-8f4fbcac8cf3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Aug 31 09:55:40.602047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 436/878] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:40.778315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:40.778914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.784779 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.785317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.785749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.786432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.787073 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.787499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.994564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.002543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.003972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.005149 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-df641b73-f3fa-4bf6-82f9-fcd37d8aac5f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.230689 Aug 31 09:55:41.006218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 443/879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:40 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:41.223914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:41.224619 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:41.230677 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.231164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.231603 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.232287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.232747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.233206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.360090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.367636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b4fff046-1b42-4ab1-94a9-fdf512c874a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.148036 Aug 31 09:55:41.368211 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 437/880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:41 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:41.738174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-765ea326-7085-4109-a1b2-bae14a0d66c7 req-314f21fd-4066-4e5a-94bb-5b08ae1e8241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "name": "network-vif-plugged", "status": "completed", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:41.748042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-765ea326-7085-4109-a1b2-bae14a0d66c7 req-314f21fd-4066-4e5a-94bb-5b08ae1e8241 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.748597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-765ea326-7085-4109-a1b2-bae14a0d66c7 req-314f21fd-4066-4e5a-94bb-5b08ae1e8241 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.749048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-765ea326-7085-4109-a1b2-bae14a0d66c7 req-314f21fd-4066-4e5a-94bb-5b08ae1e8241 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.764452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-765ea326-7085-4109-a1b2-bae14a0d66c7 req-314f21fd-4066-4e5a-94bb-5b08ae1e8241 service nova] Creating event network-vif-plugged:3166ec8b-10cf-45f0-a421-f6337342ab3b for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 on hv-cinder-83754 Aug 31 09:55:41.769375 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-765ea326-7085-4109-a1b2-bae14a0d66c7 req-314f21fd-4066-4e5a-94bb-5b08ae1e8241 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034837 Aug 31 09:55:41.770119 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 444/881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:42.028031 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:42.028651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:42.035060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.035549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.035988 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.036705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.037195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.037621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.163956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:42.171914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:42.173388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:42.174547 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0401a6c7-4aca-4c92-9efe-8bf0412682c2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.150485 Aug 31 09:55:42.175114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 438/882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:42 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:42.389120 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:42.389767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:42.395808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.396876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.397333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.398004 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.398452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.398867 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.534713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:42.542321 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4be8e6c8-014d-4e42-9042-099681a8ded4 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.157961 Aug 31 09:55:42.542887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 445/883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:42 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:43.198240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:43.198849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:43.201276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:43.206486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.206974 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.207411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.208104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.209134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.209576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.214223 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=97 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:43.338073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.346063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.347442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.348602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6ec85ace-77bf-4927-a14a-1e9a16568fde tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.154294 Aug 31 09:55:43.349702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 439/884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:43 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:43.563206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:43.563817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:43.570336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.570822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.571258 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.571946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.572431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.572853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.697819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.705360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6547657f-c723-43ef-8d56-8934c291181a tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.145960 Aug 31 09:55:43.705929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 446/885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:43 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:44.371982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:44.372535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:44.378841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.379324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.379758 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.381146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.381608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.382038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.528181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.536227 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.538226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.539386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eae413ed-1072-42a8-93ba-0c8574b6a85d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.171445 Aug 31 09:55:44.539952 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 440/886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:44 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:44.728036 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:44.728717 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:44.735530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.736012 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.736441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.737153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.737603 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.738021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.875736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.883338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d2a3859a-d726-4db1-961d-defa4c66a5f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.160658 Aug 31 09:55:44.883907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 447/887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:44 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:45.562547 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:45.563236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:45.570882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.571379 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.571935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.572644 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.573143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.573662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.706395 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:45.714954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:45.716405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:45.717609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-cae91aef-f09f-4c99-aa79-b5ca02e106f9 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.159207 Aug 31 09:55:45.718178 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 441/888] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:45 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:45.903588 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:45.904201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:45.906671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:45.912442 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.912931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.913388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.914069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.914525 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.914959 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.042448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.049996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-32895611-453b-4ad7-ba31-ecd6531b3e95 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.150305 Aug 31 09:55:46.050564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 448/889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:45 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:46.741813 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:46.742413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:46.748824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:46.749349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:46.749784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.750481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:46.750941 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:46.751372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.882675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.890763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.892210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.893411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c631c957-6224-4310-a385-0ccfc34cb43b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1745 microversion: 2.20 time: 0.155923 Aug 31 09:55:46.893975 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 442/890] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:46 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:47.070544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:47.071057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:47.077818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.078316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.078752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.079457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.079916 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.080376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.212866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:47.220498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-94abf73f-4765-4ba5-8da6-1b486f745863 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.154008 Aug 31 09:55:47.221082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 449/891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:47 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:47.801922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-26329798-6ac9-4e1a-8873-ec49e2b319c5 req-da91b87e-4788-4766-86a2-0d71d212d17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b45063-183f-4c0a-9871-d8cde6966af8", "name": "network-vif-plugged", "status": "completed", "tag": "6186ef2b-dc26-47e8-9e55-45549f6ca4ad"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:47.821822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:47.823855 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=10 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:47.832615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-26329798-6ac9-4e1a-8873-ec49e2b319c5 req-da91b87e-4788-4766-86a2-0d71d212d17e service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.833264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-26329798-6ac9-4e1a-8873-ec49e2b319c5 req-da91b87e-4788-4766-86a2-0d71d212d17e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.834839 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-26329798-6ac9-4e1a-8873-ec49e2b319c5 req-da91b87e-4788-4766-86a2-0d71d212d17e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.853093 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-26329798-6ac9-4e1a-8873-ec49e2b319c5 req-da91b87e-4788-4766-86a2-0d71d212d17e service nova] Creating event network-vif-plugged:6186ef2b-dc26-47e8-9e55-45549f6ca4ad for instance 46b45063-183f-4c0a-9871-d8cde6966af8 on hv-cinder-83754 Aug 31 09:55:47.860299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-26329798-6ac9-4e1a-8873-ec49e2b319c5 req-da91b87e-4788-4766-86a2-0d71d212d17e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064980 Aug 31 09:55:47.861663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 443/892] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:47.917708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:47.918620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:47.926396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:47.929378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.930055 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.930692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.945772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.946722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.947514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.172766 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.184217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.185961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.187346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5c93f3a2-8d88-4d9f-a002-7565292ab0af tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.275483 Aug 31 09:55:48.188429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 450/893] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:47 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:48.243533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:48.244235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:48.251173 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.251747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.252260 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.253103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.253568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.254009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.408749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.419391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8d2207e6-9c6d-46d9-af3b-53a1680cb253 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.180163 Aug 31 09:55:48.420001 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 444/894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:48 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:49.211056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:49.212029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:49.218464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.218952 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.219380 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.220072 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.220517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.220933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.371984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:49.381337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:49.383168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:49.384765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5dd2581a-e345-4bb0-a258-0de71204714c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.177689 Aug 31 09:55:49.385448 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 451/895] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:49 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:49.446543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:49.447143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:49.456441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.457377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.459336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.460381 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.461354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.462420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.621400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:49.629903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0f9ad388-386b-4113-bcd9-810a81b119a1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1366 microversion: 2.1 time: 0.189179 Aug 31 09:55:49.643718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 445/896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:49 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:50.409379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:50.410658 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:50.420055 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.421207 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.422063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.422992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.423447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.423866 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.565895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.575316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.576853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.578357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e7e25ee3-c2d9-4b56-919a-f91524015e26 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.172952 Aug 31 09:55:50.579259 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 452/897] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:50 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:50.652489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:50.653193 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:50.663282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.664058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.664508 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.665224 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.665850 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.666275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.825250 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.834270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d38eff48-baa2-4250-b8dd-51f671c767d5 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1555 microversion: 2.1 time: 0.185436 Aug 31 09:55:50.835085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 446/898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:50 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:50.858328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:50.859449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:50.868581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.869737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.870181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.870890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.871348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.871998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.876881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:50.962682 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-683ba22e-5656-4362-a15b-304ab5958bc6 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110591 Aug 31 09:55:50.963498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 453/899] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 31 09:55:50 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:51.604844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:51.605472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:51.612232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:51.612786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:51.613292 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:51.616231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:51.616231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:51.616231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:51.876467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:51.886394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:51.888214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:51.889510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a90fd95b-91ae-4a6f-8712-a28b80f500ff tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.288652 Aug 31 09:55:51.905886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 447/900] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:51 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:52.188656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-bb14571e-00e5-4c00-a342-f10b44dd48cd req-b4193594-69f1-4652-8f6d-1ef112654e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b45063-183f-4c0a-9871-d8cde6966af8", "tag": "6186ef2b-dc26-47e8-9e55-45549f6ca4ad"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:52.198834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-bb14571e-00e5-4c00-a342-f10b44dd48cd req-b4193594-69f1-4652-8f6d-1ef112654e67 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:52.199334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-bb14571e-00e5-4c00-a342-f10b44dd48cd req-b4193594-69f1-4652-8f6d-1ef112654e67 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:52.199744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-bb14571e-00e5-4c00-a342-f10b44dd48cd req-b4193594-69f1-4652-8f6d-1ef112654e67 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:52.213507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-bb14571e-00e5-4c00-a342-f10b44dd48cd req-b4193594-69f1-4652-8f6d-1ef112654e67 service nova] Creating event network-changed:6186ef2b-dc26-47e8-9e55-45549f6ca4ad for instance 46b45063-183f-4c0a-9871-d8cde6966af8 on hv-cinder-83754 Aug 31 09:55:52.218529 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-bb14571e-00e5-4c00-a342-f10b44dd48cd req-b4193594-69f1-4652-8f6d-1ef112654e67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Aug 31 09:55:52.222176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 454/901] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:52.919287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:52.920498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:52.927844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:52.928739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:52.929596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:52.930412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:52.931155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:52.931991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:53.127696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:53.140994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:53.142814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:53.143936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9ac9c9d0-b564-4cc8-822f-51716a4b34f1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.231279 Aug 31 09:55:53.144991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 448/902] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:52 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:54.181823 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:54.183025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:54.190028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.190587 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.191183 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.191942 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.193082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.193501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.348230 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:54.359690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:54.361160 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:54.362333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-28b8d6b6-2aa2-478a-9284-0c90199664f4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.198522 Aug 31 09:55:54.362897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 455/903] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:54 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:55.387128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:55.388578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:55.395397 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.395947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.396605 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.398229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.399014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.399444 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.550946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:55.560748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:55.562590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:55.564040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a61b421d-9db5-4052-be77-ee11e610e483 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.180955 Aug 31 09:55:55.564811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 449/904] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:55 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:56.588949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.589571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.595931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.596435 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.596861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.597567 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.598017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.598440 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.724848 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:56.733065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:56.734511 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:56.735649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-95450229-4751-4798-ba9d-22ed6e7ac8e2 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1740 microversion: 2.20 time: 0.150528 Aug 31 09:55:56.736208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 456/905] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:56 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:57.757908 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:57.758524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:57.765050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:57.765545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:57.765984 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:57.766690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:57.767145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:57.767571 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:57.905545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:57.914337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:57.915786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:57.917042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9c7aced5-0952-42b8-88fd-3a000f4093a3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1722 microversion: 2.20 time: 0.162983 Aug 31 09:55:57.917566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 450/906] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:57 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:58.881663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:58.882187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:58.888611 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.889140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.889579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.890271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.890730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.891155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.914476 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-26583cdb-f35a-4ed8-af1d-ca4b7d67f95d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/ips" status: 200 len: 146 microversion: 2.1 time: 0.036772 Aug 31 09:55:58.915077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 457/907] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:55:58 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:58.941940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:58.942549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:58.948994 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.949476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.949909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.950598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.951057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.951477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.080032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:59.088839 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:59.090642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:59.091954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ec27d75f-0dac-489a-80fe-b395f2f867a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1722 microversion: 2.20 time: 0.153855 Aug 31 09:55:59.092603 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 451/908] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:58 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:00.115142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:00.115764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.122417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.122913 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.123346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.124042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.124501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.124932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.244237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e53af227-a706-45bd-ad30-9df43748b5df"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:00.246621 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.253225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.253722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.254165 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.255003 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:00.255450 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.255911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.256339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.263194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:00.264637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:00.265824 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d079bde5-a5df-438e-b823-17f7db11d524 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1725 microversion: 2.20 time: 0.155096 Aug 31 09:56:00.266388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 458/909] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:00 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:00.288641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a058bff2-11d3-4507-b6f2-6672b977afbd"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:00.291305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.297628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.298195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.298628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.299331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.299787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.302812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.587098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e17b6c9b-3b13-4f01-858e-2b2c3c025315 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303107 Aug 31 09:56:00.587704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 459/910] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Aug 31 09:56:00 2022] POST /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:56:00.618769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-34972e8b-5561-4a32-8969-25cbe83eabe4 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378281 Aug 31 09:56:00.619387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 452/911] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:56:00 2022] POST /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:00.730151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:00.730685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.736899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.737439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.737880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.738628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.739177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.739607 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.144772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e904d5ca-78f2-484b-b7bc-6da263be74b1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-volume_attachments/a058bff2-11d3-4507-b6f2-6672b977afbd" status: 202 len: 0 microversion: 2.20 time: 0.418988 Aug 31 09:56:01.149208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 460/912] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Aug 31 09:56:00 2022] DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-volume_attachments/a058bff2-11d3-4507-b6f2-6672b977afbd => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:56:01.204301 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:01.205006 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:01.212308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.212806 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.213287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.213987 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.214446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.214871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.244834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132478) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 09:56:01.314457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8d4d1aef-73a3-4673-9baa-e9d1b0462505 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "POST /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/action" status: 202 len: 0 microversion: 2.20 time: 0.114314 Aug 31 09:56:01.318626 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 453/913] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 31 09:56:01 2022] POST /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:56:01.337937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:01.338559 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:01.345366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.346055 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.346335 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.346955 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.347493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.347817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.483425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:01.491652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:01.493110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:01.494283 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-274822c1-b85f-4360-a06e-c2ff7ed15eb5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1673 microversion: 2.20 time: 0.161831 Aug 31 09:56:01.494839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 461/914] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:01 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:01.822874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-ca59a305-d360-4b3d-ab00-9adefec6fae7 req-715041d4-d301-4ad0-b7fd-b32b53550f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "name": "network-vif-unplugged", "status": "completed", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:01.834087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ca59a305-d360-4b3d-ab00-9adefec6fae7 req-715041d4-d301-4ad0-b7fd-b32b53550f40 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.834957 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ca59a305-d360-4b3d-ab00-9adefec6fae7 req-715041d4-d301-4ad0-b7fd-b32b53550f40 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.835418 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-ca59a305-d360-4b3d-ab00-9adefec6fae7 req-715041d4-d301-4ad0-b7fd-b32b53550f40 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.838325 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:01.851924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.compute.server_external_events [req-ca59a305-d360-4b3d-ab00-9adefec6fae7 req-715041d4-d301-4ad0-b7fd-b32b53550f40 service nova] Unable to find a host for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35. Dropping event network-vif-unplugged {{(pid=132478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 09:56:01.852744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-ca59a305-d360-4b3d-ab00-9adefec6fae7 req-715041d4-d301-4ad0-b7fd-b32b53550f40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034863 Aug 31 09:56:01.853520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 454/915] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 09:56:02.517088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:02.517691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:02.524820 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:02.525338 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:02.525769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:02.526453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:02.526899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:02.527315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:02.696740 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:02.704925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:02.706744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:02.708482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f08e6e6d-b340-46f0-ae86-45f98279102f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.195315 Aug 31 09:56:02.709063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 462/916] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:02 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:03.732260 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:03.733554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:03.741837 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:03.742584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:03.743194 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:03.744310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:03.745113 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:03.745916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:03.907719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:03.916322 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:03.917792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:03.918954 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-abfb34ef-f8e4-4ce6-b479-3f05f0c4c39a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.191180 Aug 31 09:56:03.919686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 455/917] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:03 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:04.944554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:04.945439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:04.953194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.953762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.954270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:04.955057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.955589 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.956258 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:05.096988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:05.105665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:05.107084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:05.108233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7ef18422-c2c5-4b09-8815-d1a6b89c9e12 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.169333 Aug 31 09:56:05.108783 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 463/918] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:04 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:06.132576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:06.133296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:06.139890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:06.140386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:06.140821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.141564 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:06.142016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:06.142428 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.434108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:06.444299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:06.447643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:06.448816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-879635ef-d93b-420a-802b-9de2f61dcd9f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.320941 Aug 31 09:56:06.449402 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 456/919] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:06 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:07.472888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:07.473584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:07.480097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:07.480583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:07.481059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:07.481757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:07.482212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:07.482753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:07.619865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:07.628479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:07.630278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:07.631664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ba0460df-f7a4-484d-b3fc-8b0a5325e5b7 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.162694 Aug 31 09:56:07.632376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 464/920] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:07 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:08.655513 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:08.656126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:08.663690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:08.664181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:08.664623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:08.665374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:08.665834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:08.666263 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:08.808320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:08.816757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:08.818429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:08.819740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7093906d-d202-479a-b1cf-c3414439ebe3 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.168227 Aug 31 09:56:08.820702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 457/921] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:08 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:09.842793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:09.843480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:09.850059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:09.850552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:09.850989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:09.851690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:09.852149 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:09.852572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:09.985416 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:09.994269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:09.995721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:09.996894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-43b0eb1c-05c5-4866-af64-f9de29002eeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.158007 Aug 31 09:56:09.997665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 465/922] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:09 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:11.019545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:11.020143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:11.026611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.027103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.027538 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.028292 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.028748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.029201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.173658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:11.183451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:11.184891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:11.186094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9c888c08-09e1-4179-a828-529487946a2e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.170406 Aug 31 09:56:11.186642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 458/923] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:11 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:12.212477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:12.213316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:12.220302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:12.221147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:12.221822 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.222891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:12.223621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:12.224262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.228949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:12.424757 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:12.435140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:12.437071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:12.438478 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-56c75cd9-f0aa-4df7-ac8b-c23a4e556bac tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.230364 Aug 31 09:56:12.439747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 466/924] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:12 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:13.463166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:13.463778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:13.466099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:13.471192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.471678 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.472142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.473484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.473943 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.474369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.605023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:13.612930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:13.614435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:13.615588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fb97e186-34b6-421e-be80-7926c8b87493 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.156332 Aug 31 09:56:13.616140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 459/925] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:13 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:14.638172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:14.638782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:14.645859 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.646346 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.646779 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.647466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.647919 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.648342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.774584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:14.782656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:14.784090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:14.785271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1ca6da69-3915-4a04-9926-169877339c34 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.150953 Aug 31 09:56:14.785835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 467/926] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:14 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:15.809254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:15.809915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:15.816314 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:15.816810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:15.817289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:15.818003 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:15.818467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:15.818895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:15.945346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.953426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.954875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.956035 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3dbe0da4-0be9-4373-8018-ed0b9891a864 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.151361 Aug 31 09:56:15.957134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 460/927] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:15 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:16.979442 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:16.980086 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:16.982174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=40 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:16.987105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.987595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.988696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.989429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.989890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.990315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.119578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.127645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.129147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.130306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fa35a7a5-b292-4f07-8147-b6548e05fae4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.154835 Aug 31 09:56:17.130850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 468/928] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:16 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:18.154003 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:18.154878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:18.161973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.162454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.162885 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.163568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.164019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.164436 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.294232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:18.302234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:18.303699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:18.304863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2950c6b5-018b-4f3f-b984-30c5db239edc tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.154951 Aug 31 09:56:18.305446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 461/929] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:18 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:19.327628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:19.328238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:19.335558 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.336043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.336496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:19.337197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.337659 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.338079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:19.715310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.723778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.725249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.726424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1a4af692-433c-456b-a527-e20013a891a1 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.402730 Aug 31 09:56:19.726967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 469/930] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:19 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:20.750522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:20.751343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:20.757589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.758080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.758523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.759225 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.759696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.760116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.913962 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.922071 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.923672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.924929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7512007f-7cce-419a-92f5-54ab7beeaeeb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.178699 Aug 31 09:56:20.925641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 462/931] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:20 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:56:21.948349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:21.948977 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:21.955545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.956026 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.956471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.957189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.957641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.958061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.085909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:22.094150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:22.095602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:22.096755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-35ef6849-ad15-42cd-885f-3ea3187b162f tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.152245 Aug 31 09:56:22.097850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 470/932] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:21 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:23.119851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:23.120456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:23.126811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.127296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.127730 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.129277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.130079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.130811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.259990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.267881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.269340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.270483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7f76d9df-e57d-45ac-9847-9d8b4fe13137 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.154571 Aug 31 09:56:23.271028 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 463/933] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:23 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:24.146008 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.148459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.155144 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.155627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.156061 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.156749 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.157227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.157642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.187031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6b668b51-e900-4da6-9f83-378d6862dd26 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045540 Aug 31 09:56:24.187579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 471/934] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:24.199478 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.199964 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.206799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.207284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.207717 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.208398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.208846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.209299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.237637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6b3ee198-38a0-47c2-9746-9c6e80a9f6a7 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/e53af227-a706-45bd-ad30-9df43748b5df" status: 200 len: 194 microversion: 2.1 time: 0.042988 Aug 31 09:56:24.238196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 464/935] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/e53af227-a706-45bd-ad30-9df43748b5df => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:24.293467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.294126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.300005 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.300492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.300917 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.301630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.302080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.302497 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.675305 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.683928 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.685438 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.686614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-39aa3f03-19da-46b2-97af-d595966c3c8c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.397000 Aug 31 09:56:24.687173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 472/936] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:25.710431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:25.711058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:25.717413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.717903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.718345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.719036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.719499 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.719923 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.848616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.856601 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.858085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.859245 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1d1d0b43-2e13-49b9-b601-368fa8edfc0b tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.153333 Aug 31 09:56:25.859804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 465/937] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:25 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:26.447275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-33375740-3101-4385-96a4-d778c37dbc7f req-c14c2b95-6ca8-48c2-8af1-3b692726a7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "name": "network-vif-plugged", "status": "completed", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:26.461115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-33375740-3101-4385-96a4-d778c37dbc7f req-c14c2b95-6ca8-48c2-8af1-3b692726a7c0 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.461586 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-33375740-3101-4385-96a4-d778c37dbc7f req-c14c2b95-6ca8-48c2-8af1-3b692726a7c0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.462016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-33375740-3101-4385-96a4-d778c37dbc7f req-c14c2b95-6ca8-48c2-8af1-3b692726a7c0 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:26.474839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-33375740-3101-4385-96a4-d778c37dbc7f req-c14c2b95-6ca8-48c2-8af1-3b692726a7c0 service nova] Creating event network-vif-plugged:3166ec8b-10cf-45f0-a421-f6337342ab3b for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 on hv-cinder-83754 Aug 31 09:56:26.479819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-33375740-3101-4385-96a4-d778c37dbc7f req-c14c2b95-6ca8-48c2-8af1-3b692726a7c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037238 Aug 31 09:56:26.480426 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 473/938] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:26.882616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:26.883154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:26.889363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.889844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.890275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:26.890955 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.891406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.891870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.073460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.082158 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.083652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.084824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-421d4941-981c-43ce-a89d-2397e952f0b5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.206682 Aug 31 09:56:27.085424 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 466/939] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:26 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:27.296029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1367394035", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2048261769", "security_groups": [{"name": "tempest-secgroup-smoke-67122470"}], "block_device_mapping_v2": [{"uuid": "686c5007-8c34-423d-840b-a091d9048c5a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "017403cb-7130-4780-82b1-0da472342b0b"}]}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:27.406907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] validate_networks() for [('017403cb-7130-4780-82b1-0da472342b0b', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:56:27.697953 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a7a0b97-3f34-4fb2-8fad-3ceab4ca7b4a"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:27.700452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:27.706939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.707432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.707870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.708665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.709128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.709998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.794554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:56:27.795016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:56:27.795445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:56:27.795856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:56:27.796284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:56:27.805664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.806221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.806666 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.807663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.808124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.808549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.825407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:27.829354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Getting quotas for user 5669f5e5dcd74e01b4fb7c1bd512bd82 and project 9df6e3fe84eb42b4a1a70e76b5de9fa2. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:27.885287 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:56:27.887513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='686c5007-8c34-423d-840b-a091d9048c5a',volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:56:28.010830 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [93c92a87-f5d6-4a4f-bee4-9e44e9a732af] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 09:56:28.194915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5ba06a8f-1944-4e8b-ad11-e0ecfd0a6042 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "POST /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500730 Aug 31 09:56:28.195517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 467/940] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:56:27 2022] POST /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:28.200453 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:28.201175 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:28.207702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.208190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.208626 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.209349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.209808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.210230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.352642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:28.360768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:28.362751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:28.363924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-69a63be9-d541-48f9-99df-cbfd8ed6d305 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1731 microversion: 2.20 time: 0.167355 Aug 31 09:56:28.364475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 468/941] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:28 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:29.018259 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [93c92a87-f5d6-4a4f-bee4-9e44e9a732af] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38270. Aug 31 09:56:29.023541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-80ddbe17-0e02-466a-8bf2-a85a191a66ea tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.731668 Aug 31 09:56:29.024841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 474/942] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:56:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:56:29.035533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-be7b0be9-882e-48ae-8a34-692319ca7c0a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:29.036280 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-be7b0be9-882e-48ae-8a34-692319ca7c0a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:29.090611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-be7b0be9-882e-48ae-8a34-692319ca7c0a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.097458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-be7b0be9-882e-48ae-8a34-692319ca7c0a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1095 microversion: 2.1 time: 0.065848 Aug 31 09:56:29.098022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 469/943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:29 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:29.387982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:29.388614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:29.395706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.396232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.396688 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.397407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.397855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.398271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.535747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.544069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.545721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.546997 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5dfdc0c2-cafa-471e-babe-83049940a8fb tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1718 microversion: 2.20 time: 0.163650 Aug 31 09:56:29.547548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 475/944] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:29 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:30.118050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:30.118652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:30.125680 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.126168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.126607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.127304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.127779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.128205 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.189346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:30.197432 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8e723a42-56fa-4103-8ce6-00d5f4267d4b tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1193 microversion: 2.1 time: 0.083802 Aug 31 09:56:30.198006 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 470/945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:30 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:31.217730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:31.218350 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:31.224743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.225455 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.225897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.226592 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.227057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.227487 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.486421 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:31.495141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-864de6b7-a558-48fd-b05f-b1aa8d0be57c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1277 microversion: 2.1 time: 0.281245 Aug 31 09:56:31.495796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 476/946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:31 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:31.614356 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-242c4d6e-706b-492f-8c23-a4a299b6dc84 req-56fff495-0281-4534-a1a6-b040aabad5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6e2576-b7f0-40bf-adec-2fcb59ed5467", "tag": "0aede022-4468-4a55-88f1-cf33e1c27f70"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:31.625192 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-242c4d6e-706b-492f-8c23-a4a299b6dc84 req-56fff495-0281-4534-a1a6-b040aabad5f6 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.625822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-242c4d6e-706b-492f-8c23-a4a299b6dc84 req-56fff495-0281-4534-a1a6-b040aabad5f6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.626316 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-242c4d6e-706b-492f-8c23-a4a299b6dc84 req-56fff495-0281-4534-a1a6-b040aabad5f6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.631419 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:31.639138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-242c4d6e-706b-492f-8c23-a4a299b6dc84 req-56fff495-0281-4534-a1a6-b040aabad5f6 service nova] Creating event network-changed:0aede022-4468-4a55-88f1-cf33e1c27f70 for instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 on hv-cinder-83754 Aug 31 09:56:31.643933 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-242c4d6e-706b-492f-8c23-a4a299b6dc84 req-56fff495-0281-4534-a1a6-b040aabad5f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033976 Aug 31 09:56:31.644526 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 471/947] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:32.516064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.516679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.523314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.523801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.524234 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.524932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.525417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.525841 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.706950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.714597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-19ec2699-0279-41cb-9094-a9afa47284ac tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1277 microversion: 2.1 time: 0.202410 Aug 31 09:56:32.715156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 477/948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:32 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:33.736070 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:33.737404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:33.744342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.744766 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.745228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.745913 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.746362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.746780 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.875305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:33.883353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a88928c6-f8f3-477c-82a6-600335828409 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1277 microversion: 2.1 time: 0.152345 Aug 31 09:56:33.883917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 472/949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:33 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:34.903789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:34.904315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:34.911210 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:34.911697 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:34.912159 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:34.912847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:34.913326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:34.913750 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.046564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.054954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-222e654d-0ead-4504-9146-3d6a9e3a7bad tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1277 microversion: 2.1 time: 0.155113 Aug 31 09:56:35.055522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 478/950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:34 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:35.731653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:35.733912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:35.740345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.740878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.741399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.742092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.742546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.742970 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.773230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5402f578-471f-4a9d-a076-94317e2521a9 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045625 Aug 31 09:56:35.773773 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 473/951] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:56:35 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:35.915145 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:35.915647 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:35.922058 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.922549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.922988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.923680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.924141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.925100 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.954318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b6cccb9c-8e4b-4595-876d-d9a8f660a4f2 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/e53af227-a706-45bd-ad30-9df43748b5df" status: 200 len: 194 microversion: 2.1 time: 0.043337 Aug 31 09:56:35.954834 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 479/952] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Aug 31 09:56:35 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/e53af227-a706-45bd-ad30-9df43748b5df => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:35.965060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:35.965557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:35.971330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.971815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.972279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.972992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.973451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.973879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.052318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lazy-loading 'services' on Instance uuid 8eb255dd-7ee8-454c-8721-7be99943aa42 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:36.074936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:36.075545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:36.082031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.082536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.082983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.083729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.084190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.084622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.130860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2709794f-28ee-444c-89df-5eba61772e61 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/e53af227-a706-45bd-ad30-9df43748b5df" status: 202 len: 0 microversion: 2.1 time: 0.169460 Aug 31 09:56:36.131641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 474/953] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:56:35 2022] DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/e53af227-a706-45bd-ad30-9df43748b5df => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:56:36.237949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:36.246050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-21471705-6af2-4826-a71e-a0a9e6c90bbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1277 microversion: 2.1 time: 0.174853 Aug 31 09:56:36.246622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 480/954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:36 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:37.267878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:37.269204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:37.275412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.275902 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.276345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.277142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.277608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.278037 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.411702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:37.419305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-804b9030-82bb-49c5-8b06-012e34d72cfb tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.156099 Aug 31 09:56:37.419875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 475/955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:37 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:38.439624 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:38.440357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:38.442795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:38.443489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:38.449332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.449820 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.450280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.450967 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.451424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.451849 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.582387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:38.590386 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-956fe101-c199-43d3-b3e3-fa90350e9a72 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.154615 Aug 31 09:56:38.591038 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 481/956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:38 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:39.370143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.370674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.373120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:39.378841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.379328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.379779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.380498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.380948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.381399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.412489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-39c45037-5863-4572-8553-def41539716d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/6a7a0b97-3f34-4fb2-8fad-3ceab4ca7b4a" status: 200 len: 194 microversion: 2.1 time: 0.046381 Aug 31 09:56:39.413326 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 476/957] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Aug 31 09:56:39 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/6a7a0b97-3f34-4fb2-8fad-3ceab4ca7b4a => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:39.423799 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.424936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.430850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.431327 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.432022 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.432702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.433194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.433617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.512407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lazy-loading 'services' on Instance uuid 8eb255dd-7ee8-454c-8721-7be99943aa42 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:39.582732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-beabe105-8fce-4673-a318-774e79168a87 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/6a7a0b97-3f34-4fb2-8fad-3ceab4ca7b4a" status: 202 len: 0 microversion: 2.1 time: 0.162630 Aug 31 09:56:39.583347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 482/958] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:56:39 2022] DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments/6a7a0b97-3f34-4fb2-8fad-3ceab4ca7b4a => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:56:39.611179 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.612410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.618191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.618670 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.619104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.619834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.620310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.620736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.759262 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:39.766856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d58b1a26-2921-4e1c-8477-595c84c39e5d tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.159527 Aug 31 09:56:39.767446 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 477/959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:39 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:40.754233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.756571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:40.762780 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.763275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.763714 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.764403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.764862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.765318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.779969 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:40.786996 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.787749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:40.794408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.794891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.795323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.796008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.796460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.796881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.803827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-160c5da4-bd46-4638-8eb9-9d18b2821d5d tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055562 Aug 31 09:56:40.804755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 483/960] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:56:40 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:56:40.921106 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.923494 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:40.929956 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.930453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.930894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.931856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.932312 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.932763 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.964085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b3ec3820-a6c1-4bb3-8782-6229173d7bce tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046936 Aug 31 09:56:40.964671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 484/961] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:56:40 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:56:41.028708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:41.029236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:41.036210 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.036713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.037187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.037901 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.038357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.038781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.066388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:56:41.149485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5c39a7db-152d-47db-bf63-4bd54d668b30 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 204 len: 0 microversion: 2.1 time: 0.124156 Aug 31 09:56:41.150404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 485/962] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:56:41 2022] DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:56:41.159298 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:41.159460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:41.160008 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:41.166514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.167116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.167537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5b857314-659b-4a90-95fe-cec77bb86e87 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.384448 Aug 31 09:56:41.167686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.168107 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 478/963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:40 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:41.168310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.168791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.169260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.301047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:41.308996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5d3d82a5-ef95-4728-a3fb-d9ddd011a2bb tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1674 microversion: 2.1 time: 0.153977 Aug 31 09:56:41.309568 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 486/964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:41 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:42.190871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:42.191491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:42.199835 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.200328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.200771 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.201518 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.201982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.202413 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.330177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:42.330705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:42.330828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:42.338087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a1901394-74e9-4c8e-9fc3-9fcba8fc9c45 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.153332 Aug 31 09:56:42.338653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 479/965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:42 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:42.338793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.339235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.339679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.340385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.340846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.341300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.471226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:42.478955 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e7794b52-1654-47d0-99b8-2a9067694f11 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1674 microversion: 2.1 time: 0.152756 Aug 31 09:56:42.479529 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 487/966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:42 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:43.358438 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:43.358981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:43.365330 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.365818 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.366253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.366950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.367404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.367828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.499701 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:43.500302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:43.503589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:43.507271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.507760 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.508198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.508894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.509387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.509815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.511177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f9c33b42-8583-47d5-93cd-4465fd7a6a3f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.156666 Aug 31 09:56:43.511742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 480/967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:43 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:43.640213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:43.648643 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0614c9aa-0d3b-43c9-bc40-4eee86b4f7c0 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1674 microversion: 2.1 time: 0.152853 Aug 31 09:56:43.649300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 488/968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:43 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:44.532317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:44.532905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:44.535910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=46 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:44.541068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.541557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.541998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.542695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.543156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.543584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.669651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:44.670228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:44.670363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:44.676599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.677130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.677563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.677967 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-05c06a5f-8d18-4d5b-bbdf-68b907c38808 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.149566 Aug 31 09:56:44.678244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.678538 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 481/969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:44 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:44.678697 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.679118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.810593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:44.818424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0211b1bf-d6c2-45a1-9eb2-dcfabda6536c tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1674 microversion: 2.1 time: 0.152641 Aug 31 09:56:44.818988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 489/970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:44 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:45.698870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:45.699980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:45.708087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.708551 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.709012 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.710333 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.711148 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.711588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.746681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-b34bc3e9-9fc2-4e2e-83a2-5221e34632a2 req-ab4c0f41-6a28-4b3b-9d52-1210148e9b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb255dd-7ee8-454c-8721-7be99943aa42", "name": "network-vif-deleted", "tag": "4be9c7d2-800c-4781-97d3-dea4d43bba78"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:45.757010 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-b34bc3e9-9fc2-4e2e-83a2-5221e34632a2 req-ab4c0f41-6a28-4b3b-9d52-1210148e9b05 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.757575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-b34bc3e9-9fc2-4e2e-83a2-5221e34632a2 req-ab4c0f41-6a28-4b3b-9d52-1210148e9b05 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.758199 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-b34bc3e9-9fc2-4e2e-83a2-5221e34632a2 req-ab4c0f41-6a28-4b3b-9d52-1210148e9b05 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.770079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-b34bc3e9-9fc2-4e2e-83a2-5221e34632a2 req-ab4c0f41-6a28-4b3b-9d52-1210148e9b05 service nova] Creating event network-vif-deleted:4be9c7d2-800c-4781-97d3-dea4d43bba78 for instance 8eb255dd-7ee8-454c-8721-7be99943aa42 on hv-cinder-83754 Aug 31 09:56:45.775236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-b34bc3e9-9fc2-4e2e-83a2-5221e34632a2 req-ab4c0f41-6a28-4b3b-9d52-1210148e9b05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Aug 31 09:56:45.780454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 490/971] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:45.840690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:45.841361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:45.852229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.863891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.864710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.865855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.866539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.867028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.896892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:45.905108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-42e4eb02-f904-4c85-9a9f-9a7d635f2b15 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.210195 Aug 31 09:56:45.908308 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.909407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.910063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.910299 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 482/972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:45 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:45.910970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lazy-loading 'fault' on Instance uuid 8eb255dd-7ee8-454c-8721-7be99943aa42 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:45.955426 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0101b6f23d04016a89c986621ba5dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd1bef8389445f0a8cfe492cbf22f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:45.964279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-eac058fe-64bc-4593-a0d2-56996b1c7269 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 200 len: 1327 microversion: 2.1 time: 0.128096 Aug 31 09:56:45.965698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 491/973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:45 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:46.926245 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:46.926809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:46.933389 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.933871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.934309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.934990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.935460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.935882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.987656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:46.988250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:46.994204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.994680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.995108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.995788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.996252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.996670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.010520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] HTTP exception thrown: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Request method failure captured: Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 HTTP/1.1 Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy3_ODl8v_IbKuJtiOi_wALzDIzJhsTi6BnRrGFLqrwL1ztam_mlWnQzhn3IAZ31IqOpsRfIrHwMk1m4q006w2ihslJNoKUU4l_cR4gcH6FvyQODhE80gejNUjFJiXiXzy5aZgvE2u7WfQDed9VJY49F7C1Mud14gcAhbJG433coCrA Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:56:47.012150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3fd1bef8389445f0a8cfe492cbf22f8c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: a0101b6f23d04016a89c986621ba5dde Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:47.014043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '8eb255dd-7ee8-454c-8721-7be99943aa42'} Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:47.014931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:47.017079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:47.018565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Returning 404 to user: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:47.018565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d9c0fd3f-bb53-4278-a6c1-0bfbe229c71b tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 404 len: 111 microversion: 2.1 time: 0.030478 Aug 31 09:56:47.018565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 492/974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:46 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:56:47.021984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ab567427-b3d4-4fc1-a733-1742083bc892 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '.version_select at 0x7f0b5280a4c0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:47.029151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:47.043787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ab567427-b3d4-4fc1-a733-1742083bc892 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-574940677" status: 202 len: 0 microversion: 2.1 time: 0.025186 Aug 31 09:56:47.044361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 493/975] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 31 09:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-574940677 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:56:47.070999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:47.078971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0eea352a-53dd-4bf0-8e32-fc65cf93b8c9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.157010 Aug 31 09:56:47.079699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 483/976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:46 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:48.104086 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:48.105507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:48.113722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.114211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.114648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.115342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.115799 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.116222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.243538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:48.251155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-040875be-eec5-4df3-b260-3eb8b7808d35 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.152725 Aug 31 09:56:48.251778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 494/977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:48 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:48.620120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-db9e22d7-fbf2-433c-b349-4fdf7ab4b57e req-72640999-8d36-437f-944c-29178821f66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6e2576-b7f0-40bf-adec-2fcb59ed5467", "name": "network-vif-plugged", "status": "completed", "tag": "0aede022-4468-4a55-88f1-cf33e1c27f70"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:48.630819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-db9e22d7-fbf2-433c-b349-4fdf7ab4b57e req-72640999-8d36-437f-944c-29178821f66e service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.631334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-db9e22d7-fbf2-433c-b349-4fdf7ab4b57e req-72640999-8d36-437f-944c-29178821f66e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.631764 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-db9e22d7-fbf2-433c-b349-4fdf7ab4b57e req-72640999-8d36-437f-944c-29178821f66e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.643177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-db9e22d7-fbf2-433c-b349-4fdf7ab4b57e req-72640999-8d36-437f-944c-29178821f66e service nova] Creating event network-vif-plugged:0aede022-4468-4a55-88f1-cf33e1c27f70 for instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 on hv-cinder-83754 Aug 31 09:56:48.648128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-db9e22d7-fbf2-433c-b349-4fdf7ab4b57e req-72640999-8d36-437f-944c-29178821f66e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Aug 31 09:56:48.648882 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 484/978] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:49.271584 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:49.272911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:49.279772 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:49.280266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:49.280702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:49.281439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:49.281897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:49.282325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:49.418363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:49.425991 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-eb3306a5-1998-49f5-b349-fba5b367d102 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.158933 Aug 31 09:56:49.426546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 495/979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:49 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:50.190541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:50.191126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:50.197080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.197567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.198003 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.198683 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.199134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.199554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.212392 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] HTTP exception thrown: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Request method failure captured: Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 HTTP/1.1 Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy3_ODl8v_IbKuJtiOi_wALzDIzJhsTi6BnRrGFLqrwL1ztam_mlWnQzhn3IAZ31IqOpsRfIrHwMk1m4q006w2ihslJNoKUU4l_cR4gcH6FvyQODhE80gejNUjFJiXiXzy5aZgvE2u7WfQDed9VJY49F7C1Mud14gcAhbJG433coCrA Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:56:50.214040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3fd1bef8389445f0a8cfe492cbf22f8c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: a0101b6f23d04016a89c986621ba5dde Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.215637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '8eb255dd-7ee8-454c-8721-7be99943aa42'} Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:50.216497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.218040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.219504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Returning 404 to user: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:50.219504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0816c58f-94b0-47bd-ae2f-dda367428359 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 404 len: 111 microversion: 2.1 time: 0.029587 Aug 31 09:56:50.219504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 485/980] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:56:50 2022] DELETE /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:56:50.224079 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:50.224680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 8eb255dd-7ee8-454c-8721-7be99943aa42] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:50.230815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.231361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.231804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.232496 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.232974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.233406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.247334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] HTTP exception thrown: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Request method failure captured: Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 HTTP/1.1 Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy3_ODl8v_IbKuJtiOi_wALzDIzJhsTi6BnRrGFLqrwL1ztam_mlWnQzhn3IAZ31IqOpsRfIrHwMk1m4q006w2ihslJNoKUU4l_cR4gcH6FvyQODhE80gejNUjFJiXiXzy5aZgvE2u7WfQDed9VJY49F7C1Mud14gcAhbJG433coCrA Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:56:50.248835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3fd1bef8389445f0a8cfe492cbf22f8c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: a0101b6f23d04016a89c986621ba5dde Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.250439 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '8eb255dd-7ee8-454c-8721-7be99943aa42'} Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:50.251304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. Aug 31 09:56:50.252732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:50.254056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Returning 404 to user: Instance 8eb255dd-7ee8-454c-8721-7be99943aa42 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:50.254056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7b248476-44f6-4454-8366-4a440991874f tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42" status: 404 len: 111 microversion: 2.1 time: 0.030430 Aug 31 09:56:50.254056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 496/981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:50 2022] GET /compute/v2.1/servers/8eb255dd-7ee8-454c-8721-7be99943aa42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:56:50.445681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:50.446289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:50.452303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.452833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.453304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.454088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.454651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.455160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.583443 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:50.591078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-20b7bd01-6444-4b4c-b80c-dc7647a4f4a9 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1265 microversion: 2.1 time: 0.149235 Aug 31 09:56:50.591691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 486/982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:50 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:51.383992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:51.384492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:51.391050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.391536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.391980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.392684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.393352 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.393784 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.407937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] HTTP exception thrown: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Request method failure captured: Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee HTTP/1.1 Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy3_ODl8v_IbKuJtiOi_wALzDIzJhsTi6BnRrGFLqrwL1ztam_mlWnQzhn3IAZ31IqOpsRfIrHwMk1m4q006w2ihslJNoKUU4l_cR4gcH6FvyQODhE80gejNUjFJiXiXzy5aZgvE2u7WfQDed9VJY49F7C1Mud14gcAhbJG433coCrA Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:56:51.409672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3fd1bef8389445f0a8cfe492cbf22f8c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: a0101b6f23d04016a89c986621ba5dde Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.411246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '1e0d2303-37de-40e0-b537-804a86067dee'} Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:51.412323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.413984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.415817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Returning 404 to user: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:51.415817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5893f1ee-ce40-47d7-9c46-289ad5cba115 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 404 len: 111 microversion: 2.1 time: 0.030997 Aug 31 09:56:51.415817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 497/983] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:56:51 2022] DELETE /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:56:51.419867 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:51.420484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] [instance: 1e0d2303-37de-40e0-b537-804a86067dee] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:51.427696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.428168 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.428610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.429342 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.429803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.430232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.444191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] HTTP exception thrown: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Request method failure captured: Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee HTTP/1.1 Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy3_ODl8v_IbKuJtiOi_wALzDIzJhsTi6BnRrGFLqrwL1ztam_mlWnQzhn3IAZ31IqOpsRfIrHwMk1m4q006w2ihslJNoKUU4l_cR4gcH6FvyQODhE80gejNUjFJiXiXzy5aZgvE2u7WfQDed9VJY49F7C1Mud14gcAhbJG433coCrA Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:56:51.445720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3fd1bef8389445f0a8cfe492cbf22f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3fd1bef8389445f0a8cfe492cbf22f8c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 3fd1bef8389445f0a8cfe492cbf22f8c Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100204661 Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: a0101b6f23d04016a89c986621ba5dde Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeTestJSON-2100204661-project Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.447370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '1e0d2303-37de-40e0-b537-804a86067dee'} Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:51.448317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. Aug 31 09:56:51.449809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:51.451145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] Returning 404 to user: Instance 1e0d2303-37de-40e0-b537-804a86067dee could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:51.451145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ed7fa1b4-3e1e-46c4-a4e2-832499463937 tempest-AttachVolumeTestJSON-2100204661 tempest-AttachVolumeTestJSON-2100204661-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee" status: 404 len: 111 microversion: 2.1 time: 0.031067 Aug 31 09:56:51.451145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 487/984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:51 2022] GET /compute/v2.1/servers/1e0d2303-37de-40e0-b537-804a86067dee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:56:51.612461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:51.613168 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:51.619226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.619715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.620150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.620848 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.621330 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.621756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.847710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:51.855500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-599b4a55-3f9d-4ac0-83fc-dd1f01eed576 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1452 microversion: 2.1 time: 0.247552 Aug 31 09:56:51.856072 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 498/985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:51 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1452 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:51.876273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:51.876804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:51.883896 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.884799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.885484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.886371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.886854 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.887282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:52.022021 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:52.029871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-abf6fa5d-1cde-4a69-9171-63698095fc4e tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1452 microversion: 2.1 time: 0.157692 Aug 31 09:56:52.030441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 488/986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:51 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:53.886069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-a8137194-8f81-4366-a7b6-f10ee543bf76 req-254b3b57-3550-458f-aecf-055300ae95c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6e2576-b7f0-40bf-adec-2fcb59ed5467", "tag": "0aede022-4468-4a55-88f1-cf33e1c27f70"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:53.896714 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a8137194-8f81-4366-a7b6-f10ee543bf76 req-254b3b57-3550-458f-aecf-055300ae95c8 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:53.897514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a8137194-8f81-4366-a7b6-f10ee543bf76 req-254b3b57-3550-458f-aecf-055300ae95c8 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:53.897947 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-a8137194-8f81-4366-a7b6-f10ee543bf76 req-254b3b57-3550-458f-aecf-055300ae95c8 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:53.910490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-a8137194-8f81-4366-a7b6-f10ee543bf76 req-254b3b57-3550-458f-aecf-055300ae95c8 service nova] Creating event network-changed:0aede022-4468-4a55-88f1-cf33e1c27f70 for instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 on hv-cinder-83754 Aug 31 09:56:53.915975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-a8137194-8f81-4366-a7b6-f10ee543bf76 req-254b3b57-3550-458f-aecf-055300ae95c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033711 Aug 31 09:56:53.917148 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 499/987] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:56.108570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d256903c-a354-414c-9a37-c65d1f666308 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Action: 'create', calling method: .version_select at 0x7f0b525baee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1233162585", "metadata": {"Type": "work"}}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:56.395949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d256903c-a354-414c-9a37-c65d1f666308 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.400198 Aug 31 09:56:56.396616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 489/988] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 31 09:56:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 09:56:56.410992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a976f9a7-6622-4bfd-a1d2-0167bcef2ece tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Calling method '.version_select at 0x7f0b52a1d3a0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:56.464134 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a976f9a7-6622-4bfd-a1d2-0167bcef2ece tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8" status: 200 len: 353 microversion: 2.1 time: 0.059042 Aug 31 09:56:56.464802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 500/989] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:56:56 2022] GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:57.479082 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-39ee2f22-5edf-493b-9e33-446953ebf2ed tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Calling method '.version_select at 0x7f0b527b1ee0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:57.524861 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-39ee2f22-5edf-493b-9e33-446953ebf2ed tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8" status: 200 len: 354 microversion: 2.1 time: 0.050111 Aug 31 09:56:57.525442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 490/990] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:56:57 2022] GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:57.537934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3c26c5b5-18cb-43a9-a0d1-0eb097a19870 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Calling method '.version_select at 0x7f0b5262e550>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:57.588128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3c26c5b5-18cb-43a9-a0d1-0eb097a19870 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8" status: 200 len: 354 microversion: 2.1 time: 0.054274 Aug 31 09:56:57.588696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 501/991] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:56:57 2022] GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:57.605769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-07d995c1-121f-4112-bc00-b0466124453f tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Calling method '.version_select at 0x7f0b527b10d0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:57.665493 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-07d995c1-121f-4112-bc00-b0466124453f tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8" status: 202 len: 0 microversion: 2.1 time: 0.063445 Aug 31 09:56:57.666056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 491/992] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:56:57 2022] DELETE /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:56:57.674634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ca17027b-437f-4b3f-bfa4-180572ab17c0 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Calling method '.version_select at 0x7f0b527f3790>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:57.728221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ca17027b-437f-4b3f-bfa4-180572ab17c0 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8" status: 200 len: 353 microversion: 2.1 time: 0.057558 Aug 31 09:56:57.729424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 502/993] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:56:57 2022] GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:58.746407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2fc9dca3-8e02-4be6-950e-dc1a2b517171 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Calling method '.version_select at 0x7f0b525741f0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:58.774201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-2fc9dca3-8e02-4be6-950e-dc1a2b517171 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] HTTP exception thrown: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2fc9dca3-8e02-4be6-950e-dc1a2b517171 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Request method failure captured: Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 HTTP/1.1 Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDzBnCXcsv0SCw0HTvU6KJZP5abhuZiuZMgjrtjbelM7bbvoDpMqV3f6_wYpY7TX8WAXLs98C-OgEK-Q0efNu1QVFQvqNpJZxE8tl3WGG278Glv1HZaBX_Nj3kFoTgb71mQOiNtcHt-xn1fYJ7hrGPvfOZvB-EgSrZOx-k6Y4rBCtZ8Q Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 98e095a935ef476ca79e95b4baea91ad Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesGetTestJSON-1661750806 Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:56:58.776170 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/98e095a935ef476ca79e95b4baea91ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/98e095a935ef476ca79e95b4baea91ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/98e095a935ef476ca79e95b4baea91ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_98e095a935ef476ca79e95b4baea91ad", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesGetTestJSON-1661750806 Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 98e095a935ef476ca79e95b4baea91ad Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesGetTestJSON-1661750806 Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesGetTestJSON-1661750806-project Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 9c4b6c39117946659b2630e990468df3 Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesGetTestJSON-1661750806-project Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '87386b8b-64f6-4f0e-92dd-a5cc3ad784e8'} Aug 31 09:56:58.777763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. (HTTP 404) (Request-ID: req-f73e0614-f9b8-4c1e-bab6-4f39d920ced7) Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:58.778790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:56:58.780271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:56:58.781903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2fc9dca3-8e02-4be6-950e-dc1a2b517171 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] Returning 404 to user: Volume 87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2fc9dca3-8e02-4be6-950e-dc1a2b517171 tempest-VolumesGetTestJSON-1661750806 tempest-VolumesGetTestJSON-1661750806-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8" status: 404 len: 109 microversion: 2.1 time: 0.035481 Aug 31 09:56:58.783710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 492/994] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:56:58 2022] GET /compute/v2.1/os-volumes/87386b8b-64f6-4f0e-92dd-a5cc3ad784e8 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:57:44.703726 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:44.704479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:44.708547 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-490126463", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:44.762703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] validate_networks() for None {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:57:45.037979 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:57:45.038407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:57:45.038884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:57:45.039298 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:57:45.039745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:57:45.049201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:45.049692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:45.050130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:45.050857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:45.051317 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:45.051743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:45.068569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Getting quotas for project 5906bfeb2bd24a289ce3232c44ffa95a. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:57:45.072618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Getting quotas for user 306a7feefe924fcdb869f8cc34f04c4d and project 5906bfeb2bd24a289ce3232c44ffa95a. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:57:45.085070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:57:45.087501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:57:45.133153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-51ac2223-cc34-42f2-a70f-cab08677d4eb tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431067 Aug 31 09:57:45.133792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 503/995] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:57:45.142961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=15 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:45.143871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:45.145577 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 09:57:45.145937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Wed Aug 31 09:57:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 (ip 10.222.0.25) !!! Aug 31 09:57:45.158201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6b7729a5-f314-48ae-8a63-63d1185d3b6a tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:45.158827 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6b7729a5-f314-48ae-8a63-63d1185d3b6a tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:45.213388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-6b7729a5-f314-48ae-8a63-63d1185d3b6a tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:45.220812 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6b7729a5-f314-48ae-8a63-63d1185d3b6a tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1214 microversion: 2.1 time: 0.080010 Aug 31 09:57:45.221419 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 493/996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:45 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:46.241748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:46.242356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:46.249082 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:46.249564 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:46.249990 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:46.250668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:46.251116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:46.251531 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:46.312549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:46.320114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-604468f8-7167-48fd-a4ee-df95440b1cc6 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1266 microversion: 2.1 time: 0.082778 Aug 31 09:57:46.320678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 504/997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:46 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:47.341376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:47.341972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:47.349656 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:47.350138 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:47.350566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:47.351466 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:47.351915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:47.352517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:47.493799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:47.503409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0c4e0f2f-8af5-4265-beb6-01a0140c3c9d tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.165821 Aug 31 09:57:47.504085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 494/998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:47 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:48.030063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-e440aaa6-ce7e-45de-92e7-164c6c7ae407 req-1bce8406-58ee-4709-8dd1-ed7b18410ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c441035-fd14-4fed-a218-6a1170b3b8a4", "tag": "e28e5e0d-aedc-4a15-919d-dc7d7575f10c"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:48.039368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e440aaa6-ce7e-45de-92e7-164c6c7ae407 req-1bce8406-58ee-4709-8dd1-ed7b18410ada service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:48.039849 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e440aaa6-ce7e-45de-92e7-164c6c7ae407 req-1bce8406-58ee-4709-8dd1-ed7b18410ada service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:48.040280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e440aaa6-ce7e-45de-92e7-164c6c7ae407 req-1bce8406-58ee-4709-8dd1-ed7b18410ada service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:48.051102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-e440aaa6-ce7e-45de-92e7-164c6c7ae407 req-1bce8406-58ee-4709-8dd1-ed7b18410ada service nova] Creating event network-changed:e28e5e0d-aedc-4a15-919d-dc7d7575f10c for instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 on hv-cinder-83754 Aug 31 09:57:48.056220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-e440aaa6-ce7e-45de-92e7-164c6c7ae407 req-1bce8406-58ee-4709-8dd1-ed7b18410ada service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153654 Aug 31 09:57:48.056807 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 505/999] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:48.524337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:48.524935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:48.531308 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:48.531796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:48.532231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:48.532926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:48.533419 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:48.533847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:48.661051 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:48.668806 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-38acdf99-be3b-4ad9-b170-b7e560df4928 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.148321 Aug 31 09:57:48.669510 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 495/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:48 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:49.693835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:49.694539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:49.700707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:49.701227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:49.701669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:49.702398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:49.703371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:49.703797 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:49.830488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:49.838084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-344a5998-1de2-48dd-b2a5-83e173b6dc94 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.148997 Aug 31 09:57:49.838644 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 506/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:49 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:50.859050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:50.859651 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:50.865972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:50.866450 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:50.866881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:50.867559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:50.868008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:50.868425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:50.997156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:51.005417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9a27b811-9ddc-46c2-9afd-0e07bfe94556 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.150137 Aug 31 09:57:51.005982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 496/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:50 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:52.026746 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:52.027355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:52.034250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:52.034740 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:52.035176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:52.035867 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:52.036320 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:52.036745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:52.211687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:52.220250 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-509bd905-06e3-44b7-a9b1-d17ded3b4f87 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.197144 Aug 31 09:57:52.220537 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 507/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:52 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:53.240401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:53.240933 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:53.247406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:53.247893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:53.248329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:53.249604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:53.250063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:53.250489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:53.376208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:53.383948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7e4228fa-bbfc-4982-a442-801c8b30eda3 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.147528 Aug 31 09:57:53.384523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 497/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:53 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:54.405941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:54.406490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:54.412761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:54.413273 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:54.413705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:54.414384 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:54.414832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:54.415252 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:54.543069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:54.550770 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-34bd4747-67ef-4cf4-97e5-310d2c199e84 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.149476 Aug 31 09:57:54.551343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 508/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:54 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:55.202290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-5a702a66-b459-46e4-868b-a50a248bf4a2 req-18226e80-7eee-4c44-8e00-a09aaf7b6527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c441035-fd14-4fed-a218-6a1170b3b8a4", "name": "network-vif-plugged", "status": "completed", "tag": "e28e5e0d-aedc-4a15-919d-dc7d7575f10c"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:55.212197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-5a702a66-b459-46e4-868b-a50a248bf4a2 req-18226e80-7eee-4c44-8e00-a09aaf7b6527 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:55.212686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-5a702a66-b459-46e4-868b-a50a248bf4a2 req-18226e80-7eee-4c44-8e00-a09aaf7b6527 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:55.213154 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-5a702a66-b459-46e4-868b-a50a248bf4a2 req-18226e80-7eee-4c44-8e00-a09aaf7b6527 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:55.217223 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:55.226219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-5a702a66-b459-46e4-868b-a50a248bf4a2 req-18226e80-7eee-4c44-8e00-a09aaf7b6527 service nova] Creating event network-vif-plugged:e28e5e0d-aedc-4a15-919d-dc7d7575f10c for instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 on hv-cinder-83754 Aug 31 09:57:55.231403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-5a702a66-b459-46e4-868b-a50a248bf4a2 req-18226e80-7eee-4c44-8e00-a09aaf7b6527 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032882 Aug 31 09:57:55.232006 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 498/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:55.571468 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:55.572230 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:55.574241 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:55.574906 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:55.582043 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:55.582562 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:55.583002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:55.583707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:55.584163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:55.584591 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:55.714077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:55.721745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8b76b80e-ab39-4157-b995-541cc0fa7435 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.154156 Aug 31 09:57:55.722313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 509/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:55 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:56.743259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:56.743949 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:56.750653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:56.751140 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:56.751569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:56.752253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:56.752704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:56.753157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:56.883657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:56.892604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-92071218-4039-4720-a7c4-0ded0cee74d7 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.153921 Aug 31 09:57:56.893210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 499/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:56 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:57.913264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:57.913855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:57.920295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:57.921433 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:57.921877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:57.922571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:57.923029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:57.923457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:58.051017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:58.058935 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-81276e46-21ed-41bb-9c52-c07fe018ff67 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1314 microversion: 2.1 time: 0.149573 Aug 31 09:57:58.059502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 510/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:57 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:59.079950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:59.080557 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:59.087053 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.087536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.087969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.088660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.089145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.089940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.216719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:59.225009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4c228bed-81af-4746-876d-478dcfcb4108 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1464 microversion: 2.1 time: 0.149415 Aug 31 09:57:59.225575 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 500/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:59 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:59.269062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:59.269561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:59.275897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.276387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.276815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.277539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.277997 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.278420 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.303291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:57:59.379574 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5cf979af-edb1-4115-98a1-f31ef1ec725f tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 204 len: 0 microversion: 2.1 time: 0.114711 Aug 31 09:57:59.380080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 511/1011] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:57:59 2022] DELETE /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:57:59.390241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:59.390907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:59.396845 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.397378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.397820 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.398515 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.398974 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.399398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.528420 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:59.536270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-337a9bf0-ed78-42f2-bd4b-3228048d4aba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1470 microversion: 2.1 time: 0.151626 Aug 31 09:57:59.536844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 501/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:59 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:00.557984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:00.558687 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:00.565128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:00.565617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:00.566060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:00.566753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:00.567217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:00.567642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:00.702240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:00.710126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-db0ec94c-2d2a-4aaa-adde-af14008ed3ba tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1470 microversion: 2.1 time: 0.156710 Aug 31 09:58:00.710699 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 512/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:00 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:01.731310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:01.731925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:01.738571 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.739059 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.739496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.740190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.740646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.741103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.872884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:01.880450 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3ba698cc-23cb-4718-8e71-e0a9ff430e6e tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1470 microversion: 2.1 time: 0.152984 Aug 31 09:58:01.881029 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 502/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:01 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:02.385876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-e48c3359-1e78-484d-a32f-858a141f7539 req-ce5722ce-0933-4d32-89c9-cbfa42b0ae7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c441035-fd14-4fed-a218-6a1170b3b8a4", "name": "network-vif-deleted", "tag": "e28e5e0d-aedc-4a15-919d-dc7d7575f10c"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:02.396754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e48c3359-1e78-484d-a32f-858a141f7539 req-ce5722ce-0933-4d32-89c9-cbfa42b0ae7f service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.397272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e48c3359-1e78-484d-a32f-858a141f7539 req-ce5722ce-0933-4d32-89c9-cbfa42b0ae7f service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.397704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e48c3359-1e78-484d-a32f-858a141f7539 req-ce5722ce-0933-4d32-89c9-cbfa42b0ae7f service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.409543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-e48c3359-1e78-484d-a32f-858a141f7539 req-ce5722ce-0933-4d32-89c9-cbfa42b0ae7f service nova] Creating event network-vif-deleted:e28e5e0d-aedc-4a15-919d-dc7d7575f10c for instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 on hv-cinder-83754 Aug 31 09:58:02.414623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-e48c3359-1e78-484d-a32f-858a141f7539 req-ce5722ce-0933-4d32-89c9-cbfa42b0ae7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032347 Aug 31 09:58:02.415474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 513/1015] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:02.903481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:02.904020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:02.910934 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.911422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.911863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.912559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.913044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.913476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.943555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.944036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.944475 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.944917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lazy-loading 'fault' on Instance uuid 7c441035-fd14-4fed-a218-6a1170b3b8a4 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:02.986287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a7feefe924fcdb869f8cc34f04c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5906bfeb2bd24a289ce3232c44ffa95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:02.993848 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8f5291eb-7e80-49c7-84b9-4516e271c44b tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 200 len: 1304 microversion: 2.1 time: 0.094301 Aug 31 09:58:02.994407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 503/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:02 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:04.016673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:04.017395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] [instance: 7c441035-fd14-4fed-a218-6a1170b3b8a4] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:04.023627 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.024116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.024550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.025269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.025727 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.026151 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.039227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] HTTP exception thrown: Instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 could not be found. Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Request method failure captured: Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 HTTP/1.1 Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDzCW3eaM-w7dGENWw02OKvBU6wa8xtEYf5FI5JEbe1WQuVLF9S71J1lOlgJBNoKWGhHZAItAiiMDTr7U-rMPY354JHFqigFs92UT2JO81b5lFY4bP4jIuVtLvKFLTFjiuU2tl1mz9MF8I5PWFIzxcUNiR2C5SMEe4cpg3sultm8QOEk Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 5906bfeb2bd24a289ce3232c44ffa95a Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesNegativeTest-821940386 Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:04.040862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5906bfeb2bd24a289ce3232c44ffa95a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5906bfeb2bd24a289ce3232c44ffa95a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5906bfeb2bd24a289ce3232c44ffa95a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5906bfeb2bd24a289ce3232c44ffa95a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesNegativeTest-821940386 Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 5906bfeb2bd24a289ce3232c44ffa95a Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesNegativeTest-821940386 Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesNegativeTest-821940386-project Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 306a7feefe924fcdb869f8cc34f04c4d Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesNegativeTest-821940386-project Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 could not be found. Aug 31 09:58:04.042630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '7c441035-fd14-4fed-a218-6a1170b3b8a4'} Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 could not be found. Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:04.043720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 could not be found. Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 could not be found. Aug 31 09:58:04.045381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:04.046805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] Returning 404 to user: Instance 7c441035-fd14-4fed-a218-6a1170b3b8a4 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:04.046805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-35255d52-e0fe-46af-b85f-61a5b57102c8 tempest-VolumesNegativeTest-821940386 tempest-VolumesNegativeTest-821940386-project] 10.222.0.25 "GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4" status: 404 len: 111 microversion: 2.1 time: 0.030911 Aug 31 09:58:04.046805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 514/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:04 2022] GET /compute/v2.1/servers/7c441035-fd14-4fed-a218-6a1170b3b8a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:06.195531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:06.196026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:06.205317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.205715 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.206147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.206849 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.207305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.207754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.231287 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e3af3c86-a60c-43f6-9d04-c7594572df6b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/ips" status: 200 len: 149 microversion: 2.1 time: 0.176534 Aug 31 09:58:06.232195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 504/1018] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:58:06 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/ips => generated 149 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:08.632159 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c68fc777-664b-4c00-b2b4-cbad09024414"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:08.634522 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:08.641100 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:08.641580 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:08.642011 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:08.642693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:08.643141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:08.643556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:08.930817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e633b9f2-4db2-44cf-903a-10a6d4410620 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "POST /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302032 Aug 31 09:58:08.931457 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 515/1019] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:58:08 2022] POST /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:11.524226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:11.526569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:11.533869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.534430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.534932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.535696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.536235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.536728 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.566894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4a9ec283-8855-4a5c-a8fa-86d12f8e805d tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046615 Aug 31 09:58:11.567693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 505/1020] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 31 09:58:11 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:11.629336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:11.629931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:11.636769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.637374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.637817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.639013 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.639470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.639893 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.665360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:58:11.739265 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0a70cf60-f853-439b-b16c-123495a6c087 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 204 len: 0 microversion: 2.20 time: 0.113890 Aug 31 09:58:11.743619 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 516/1021] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 31 09:58:11 2022] DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:58:11.749947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:11.750653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:11.756862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.757378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.757815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.758509 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.758964 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.759391 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.888172 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:11.898208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:11.899660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:11.900828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-777dbd38-3dd2-430e-acaa-9bac528f9ec5 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.156333 Aug 31 09:58:11.901414 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 506/1022] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:11 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:12.924898 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:12.925561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:12.932154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:12.932638 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:12.933101 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.933795 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:12.934245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:12.934666 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.952829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:13.081209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.089347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.090796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.092467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f19bd2c9-3004-4eb2-a657-1bd9b022a33c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.172053 Aug 31 09:58:13.094801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 517/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:12 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:14.116164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:14.116779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:14.123156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:14.123636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:14.124069 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:14.124754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:14.125235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:14.125659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:14.254075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.262114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.264185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.265487 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d7704aa4-59f2-433a-b3eb-9dd3bca9f472 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.153104 Aug 31 09:58:14.266014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 507/1024] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:14 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:15.287707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:15.288315 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:15.290650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:15.296474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:15.296989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:15.297422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:15.298116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:15.298569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:15.298996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:15.435665 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:15.443697 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:15.445175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:15.446336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-82dcb57e-55f2-4cdb-b114-eab902497c54 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.162623 Aug 31 09:58:15.446895 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 518/1025] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:15 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:16.470067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:16.470801 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:16.473292 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=35 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:16.478234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:16.478726 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:16.479136 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:16.479826 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:16.480278 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:16.480699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:16.485551 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=81 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:16.611973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.620182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.621654 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.622823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e552a7e1-d611-4d84-b1d1-97feaa35c821 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.157233 Aug 31 09:58:16.623384 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 508/1026] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:16 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:17.645389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:17.646001 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:17.652480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:17.652911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:17.653378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:17.654670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:17.655125 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:17.655556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:17.787427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:17.795671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:17.797141 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:17.798349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-950ae192-fb2a-4e14-97d7-d1610d3146c4 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.156942 Aug 31 09:58:17.799153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 519/1027] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:17 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:18.821244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:18.821852 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:18.828197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:18.828680 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:18.829164 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:18.829856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:18.830311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:18.830736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:18.965400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.973857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.975309 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.976476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4cba4a8a-a300-431f-ae71-5bf26311155e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1724 microversion: 2.20 time: 0.159182 Aug 31 09:58:18.977045 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 509/1028] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:18 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:19.741232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:19.741792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:19.748243 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.748732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.749205 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.749903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.750360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.750790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.832423 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'services' on Instance uuid 46b45063-183f-4c0a-9871-d8cde6966af8 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:19.907528 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a4e94fff-f920-481a-831b-f66f25c197c1 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments/c68fc777-664b-4c00-b2b4-cbad09024414" status: 202 len: 0 microversion: 2.1 time: 0.170031 Aug 31 09:58:19.908148 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 520/1029] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 09:58:19 2022] DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments/c68fc777-664b-4c00-b2b4-cbad09024414 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:19.916502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:19.918874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:19.925980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.926427 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.927103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.927946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.928409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.928841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.967500 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-977d3d2c-c8a8-4a7b-9820-a166cff65b49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054920 Aug 31 09:58:19.968166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 510/1030] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:19 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:20.002821 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:20.003125 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:20.009601 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.010085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.010515 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.011209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.011664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.012227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.363493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.373175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.374648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.375945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-78b3d0ca-41e6-4560-8971-352bdc309741 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1657 microversion: 2.20 time: 0.378599 Aug 31 09:58:20.376744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 521/1031] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:19 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1657 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:20.547408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-76e01dac-0ae2-4ede-82fd-5ae48afe0457 req-0fe779f5-6931-4bd5-9a4d-052e76beb6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af107e2b-f03b-4aff-ad71-c4f20b8f5f35", "name": "network-vif-deleted", "tag": "3166ec8b-10cf-45f0-a421-f6337342ab3b"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:20.556768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-76e01dac-0ae2-4ede-82fd-5ae48afe0457 req-0fe779f5-6931-4bd5-9a4d-052e76beb6b8 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.557201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-76e01dac-0ae2-4ede-82fd-5ae48afe0457 req-0fe779f5-6931-4bd5-9a4d-052e76beb6b8 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.557628 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-76e01dac-0ae2-4ede-82fd-5ae48afe0457 req-0fe779f5-6931-4bd5-9a4d-052e76beb6b8 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.570229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-76e01dac-0ae2-4ede-82fd-5ae48afe0457 req-0fe779f5-6931-4bd5-9a4d-052e76beb6b8 service nova] Creating event network-vif-deleted:3166ec8b-10cf-45f0-a421-f6337342ab3b for instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 on hv-cinder-83754 Aug 31 09:58:20.575517 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-76e01dac-0ae2-4ede-82fd-5ae48afe0457 req-0fe779f5-6931-4bd5-9a4d-052e76beb6b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032763 Aug 31 09:58:20.576698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 511/1032] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:20.979980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:20.982281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:20.989191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.989672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.990098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.990785 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.991232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.991650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.022070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-66a219d9-fbbc-4cd3-9d74-95747fb49605 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Aug 31 09:58:21.022630 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 522/1033] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:20 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:21.400808 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:21.401484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:21.407915 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.408408 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.408854 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.409596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.410056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.410485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.479537 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.488227 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.489711 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.490881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-274a5276-90b0-447c-9923-0fec1dda6634 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1657 microversion: 2.20 time: 0.094987 Aug 31 09:58:21.491445 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 512/1034] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:21 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:22.033911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:22.036115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:22.042543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:22.043028 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:22.043466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:22.044153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:22.044604 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:22.045056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:22.074619 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-416b8fc6-de6f-40af-bb7e-c7a862d262f3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Aug 31 09:58:22.075188 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 523/1035] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:22 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:22.514459 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:22.515066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:22.521647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:22.522132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:22.522566 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:22.523251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:22.523707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:22.524133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:22.588876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:22.597139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:22.598595 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:22.599755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-85e73bd4-0c41-4f6f-8bc7-04869cf08898 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1657 microversion: 2.20 time: 0.090013 Aug 31 09:58:22.600317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 513/1036] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:22 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:23.087571 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:23.089798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:23.096925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.097454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.097889 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.098580 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.099037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.099459 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.128159 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4f81c2ec-9e5a-4862-8b3b-c03857d04d87 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 31 09:58:23.128708 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 524/1037] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:23 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:23.622649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:23.623248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:23.629834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.630328 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.630789 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.631496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.631957 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.632385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.693143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:23.701628 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:23.703077 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:23.704238 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-36a3df24-d1ad-4723-9de8-38faf37a7919 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1657 microversion: 2.20 time: 0.085502 Aug 31 09:58:23.704804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 514/1038] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:23 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:24.140347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:24.142518 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:24.148978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.149468 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.149902 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.150594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.151048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.151471 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.182600 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e6e47482-98e2-4143-b25b-0cc368fd95bc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Aug 31 09:58:24.183166 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 525/1039] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:24 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:24.728618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:24.729259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:24.735618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.736099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.736530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.737248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.737704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.738126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.799549 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:24.807755 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:24.809236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:24.810385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ce20189c-fce6-41e2-b093-939fd905137e tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1657 microversion: 2.20 time: 0.085742 Aug 31 09:58:24.810965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 515/1040] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:24 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:25.194888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:25.197075 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:25.204018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.204504 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.205070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.205685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.206138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.206566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.236724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1b19652e-557d-4421-8471-f0559317623e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Aug 31 09:58:25.237333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 526/1041] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:25 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:25.833323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:25.833916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:25.840096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.840569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.841068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.841754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.842207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.842629 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.908858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.916874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.918324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '468522570ba7419c87da6d05fc0d1ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16af15e86174ab1b9344d35ffe0844d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.920015 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-94322270-d119-49ea-8e9d-10bdcca85280 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 200 len: 1367 microversion: 2.20 time: 0.090593 Aug 31 09:58:25.920568 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 516/1042] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:25 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:26.248183 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:26.250367 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:26.256640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.257167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.257597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.258286 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.258735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.259158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.291373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c9104550-36fe-4580-be54-4c1058038819 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 Aug 31 09:58:26.291937 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 527/1043] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:26 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:26.943185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:26.943797 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:26.950725 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.951220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.951659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.952351 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.952809 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.953266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.966898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] HTTP exception thrown: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Request method failure captured: Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 HTTP/1.1 Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy31cExfG4ps9FrZ47yAbijG_SfwQk_BCA0VlXav09mPaz4KqynNEw4MRPGwG9DU0D11Iu9lR8htdlrI0AfL4QbadNn2aFOApPb2qh8wPqQblriVxFMye7ktpDoUdHVUKbprsbPz3ki9kUQY-JSXQ7K8kKEYi8cFpoJZ3-BpxlKd06E Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:26.968531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16af15e86174ab1b9344d35ffe0844d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 468522570ba7419c87da6d05fc0d1ff1 Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:26.970273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'af107e2b-f03b-4aff-ad71-c4f20b8f5f35'} Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:26.971396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:26.972998 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:26.974486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Returning 404 to user: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:26.974486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-eacebf7a-9354-48a7-8ac2-f76c6c523820 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 404 len: 111 microversion: 2.20 time: 0.030717 Aug 31 09:58:26.974486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 517/1044] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:26 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:58:26.978696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9c900d7f-c7a1-4b8d-97f3-64d861d4894a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '.version_select at 0x7f0b52834310>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:26.996712 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9c900d7f-c7a1-4b8d-97f3-64d861d4894a tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456552439" status: 204 len: 0 microversion: 2.20 time: 0.021831 Aug 31 09:58:26.997789 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 528/1045] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Aug 31 09:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456552439 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:58:27.304430 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:27.306704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:27.313440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.313937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.314383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.315092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.315554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.315981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.348048 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e6bdf9d5-8928-43af-81f4-88db9180e111 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047970 Aug 31 09:58:27.348635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 518/1046] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:27 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:58:27.412640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:27.413820 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:27.421456 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.421950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.422383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.423080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.423530 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.423948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.450771 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:58:27.531738 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9c5149ac-5b13-4ba0-be1d-a1ab3f833aaa tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 204 len: 0 microversion: 2.1 time: 0.123307 Aug 31 09:58:27.532503 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 529/1047] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:27 2022] DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:58:27.540612 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:27.541288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:27.547843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.548327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.548761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.549484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.549937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.550360 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.747802 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:27.756014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-561a795e-ce26-45ac-bd8a-278e4c0741cc tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.219202 Aug 31 09:58:27.756585 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 519/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:27 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:28.779012 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:28.779649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:28.786074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:28.786555 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:28.786994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:28.787677 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:28.788128 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:28.788549 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:28.915732 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:28.923538 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-77c64ce2-b12d-4a16-bac5-725c1c40e38c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.149380 Aug 31 09:58:28.924134 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 530/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:28 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:29.944981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:29.945586 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:29.951942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.952423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.952857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.953573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.954034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.954458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:30.085615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:30.094285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-add7a9c7-fca5-421c-94fb-515a51de4e76 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.153203 Aug 31 09:58:30.094863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 520/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:29 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:31.116142 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:31.116747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:31.123955 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:31.124432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:31.124862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:31.125572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:31.126021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:31.126438 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:31.265575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:31.278623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-234f1287-4f06-44aa-aad1-f9d587e032fb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.166092 Aug 31 09:58:31.279328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 531/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:31 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:32.299705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:32.300368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:32.306697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:32.307176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:32.307602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:32.308283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:32.308733 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:32.309182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:32.432869 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:32.440928 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-379e73d6-0ad8-4912-a3a6-9304456afe9c tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.145054 Aug 31 09:58:32.441512 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 521/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:32 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:33.259839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:33.260337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:33.267334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.267817 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.268255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.268944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.269431 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.269853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.283121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] HTTP exception thrown: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Request method failure captured: Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 HTTP/1.1 Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy31cExfG4ps9FrZ47yAbijG_SfwQk_BCA0VlXav09mPaz4KqynNEw4MRPGwG9DU0D11Iu9lR8htdlrI0AfL4QbadNn2aFOApPb2qh8wPqQblriVxFMye7ktpDoUdHVUKbprsbPz3ki9kUQY-JSXQ7K8kKEYi8cFpoJZ3-BpxlKd06E Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:33.284794 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16af15e86174ab1b9344d35ffe0844d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 468522570ba7419c87da6d05fc0d1ff1 Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.286514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'af107e2b-f03b-4aff-ad71-c4f20b8f5f35'} Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:33.287669 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.289173 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.290812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Returning 404 to user: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:33.290812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8fc7ee0f-d510-41a6-b5ae-e6feb4887443 tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 404 len: 111 microversion: 2.20 time: 0.030227 Aug 31 09:58:33.290812 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 532/1053] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 31 09:58:33 2022] DELETE /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:58:33.294976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:33.295591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: af107e2b-f03b-4aff-ad71-c4f20b8f5f35] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:33.301462 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.302013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.302371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.303064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.303524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.304208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.318974 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] HTTP exception thrown: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Request method failure captured: Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 HTTP/1.1 Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy31cExfG4ps9FrZ47yAbijG_SfwQk_BCA0VlXav09mPaz4KqynNEw4MRPGwG9DU0D11Iu9lR8htdlrI0AfL4QbadNn2aFOApPb2qh8wPqQblriVxFMye7ktpDoUdHVUKbprsbPz3ki9kUQY-JSXQ7K8kKEYi8cFpoJZ3-BpxlKd06E Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:33.320495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16af15e86174ab1b9344d35ffe0844d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 468522570ba7419c87da6d05fc0d1ff1 Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.321918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'af107e2b-f03b-4aff-ad71-c4f20b8f5f35'} Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:33.322734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. Aug 31 09:58:33.324132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:33.325810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Returning 404 to user: Instance af107e2b-f03b-4aff-ad71-c4f20b8f5f35 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:33.325810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9784cdec-28c9-44b3-9f24-e164154f00be tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35" status: 404 len: 111 microversion: 2.20 time: 0.030898 Aug 31 09:58:33.325810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 522/1054] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:33 2022] GET /compute/v2.1/servers/af107e2b-f03b-4aff-ad71-c4f20b8f5f35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 09:58:33.461764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:33.462375 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:33.469430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.469914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.470348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.471034 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.471488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.471909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.490220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:33.607080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:33.614706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-15b83534-0b3b-47d6-a4bd-1825f9ed3208 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.156746 Aug 31 09:58:33.615260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 533/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:33 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:34.458657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:34.459145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:34.466234 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.466718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.467150 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.468142 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.468595 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.469056 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.483004 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] HTTP exception thrown: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Request method failure captured: Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a HTTP/1.1 Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy31cExfG4ps9FrZ47yAbijG_SfwQk_BCA0VlXav09mPaz4KqynNEw4MRPGwG9DU0D11Iu9lR8htdlrI0AfL4QbadNn2aFOApPb2qh8wPqQblriVxFMye7ktpDoUdHVUKbprsbPz3ki9kUQY-JSXQ7K8kKEYi8cFpoJZ3-BpxlKd06E Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:34.484562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16af15e86174ab1b9344d35ffe0844d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 468522570ba7419c87da6d05fc0d1ff1 Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.486240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '0fb4356f-6089-4087-9f63-a48ff6bcb08a'} Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:34.487118 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.488615 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.490570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Returning 404 to user: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:34.490570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a4122896-f0d7-486f-8d3e-354d2df1f39c tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 404 len: 111 microversion: 2.20 time: 0.031270 Aug 31 09:58:34.490570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 523/1056] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 31 09:58:34 2022] DELETE /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:58:34.494461 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:34.495066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] [instance: 0fb4356f-6089-4087-9f63-a48ff6bcb08a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:34.501427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.501925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.502336 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.503020 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.503465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.503881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.516978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] HTTP exception thrown: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Request method failure captured: Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a HTTP/1.1 Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy31cExfG4ps9FrZ47yAbijG_SfwQk_BCA0VlXav09mPaz4KqynNEw4MRPGwG9DU0D11Iu9lR8htdlrI0AfL4QbadNn2aFOApPb2qh8wPqQblriVxFMye7ktpDoUdHVUKbprsbPz3ki9kUQY-JSXQ7K8kKEYi8cFpoJZ3-BpxlKd06E Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:34.518481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16af15e86174ab1b9344d35ffe0844d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16af15e86174ab1b9344d35ffe0844d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: d16af15e86174ab1b9344d35ffe0844d Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-771258386 Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 468522570ba7419c87da6d05fc0d1ff1 Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeShelveTestJSON-771258386-project Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.520088 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '0fb4356f-6089-4087-9f63-a48ff6bcb08a'} Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:34.521059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. Aug 31 09:58:34.522545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.523884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] Returning 404 to user: Instance 0fb4356f-6089-4087-9f63-a48ff6bcb08a could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:34.523884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-141e7298-1570-4a17-8c5c-20529ff21dda tempest-AttachVolumeShelveTestJSON-771258386 tempest-AttachVolumeShelveTestJSON-771258386-project] 10.222.0.25 "GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a" status: 404 len: 111 microversion: 2.20 time: 0.029184 Aug 31 09:58:34.523884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 534/1057] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:34 2022] GET /compute/v2.1/servers/0fb4356f-6089-4087-9f63-a48ff6bcb08a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:58:34.635911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:34.636550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:34.642634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.643277 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.643923 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.644622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.645103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.645579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.908052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:34.916063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9f96e94f-b107-4f9e-89ac-169e8190b90b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1680 microversion: 2.1 time: 0.284264 Aug 31 09:58:34.916637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 524/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:34 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:35.572879 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-f7b70f62-68b6-4e1f-9cbb-0c5d7aa72f4a req-f256b463-da80-4780-a27e-b7bfdd951917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b45063-183f-4c0a-9871-d8cde6966af8", "name": "network-vif-deleted", "tag": "6186ef2b-dc26-47e8-9e55-45549f6ca4ad"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:35.587986 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f7b70f62-68b6-4e1f-9cbb-0c5d7aa72f4a req-f256b463-da80-4780-a27e-b7bfdd951917 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.589755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f7b70f62-68b6-4e1f-9cbb-0c5d7aa72f4a req-f256b463-da80-4780-a27e-b7bfdd951917 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.591739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f7b70f62-68b6-4e1f-9cbb-0c5d7aa72f4a req-f256b463-da80-4780-a27e-b7bfdd951917 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.612944 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-f7b70f62-68b6-4e1f-9cbb-0c5d7aa72f4a req-f256b463-da80-4780-a27e-b7bfdd951917 service nova] Creating event network-vif-deleted:6186ef2b-dc26-47e8-9e55-45549f6ca4ad for instance 46b45063-183f-4c0a-9871-d8cde6966af8 on hv-cinder-83754 Aug 31 09:58:35.620528 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-f7b70f62-68b6-4e1f-9cbb-0c5d7aa72f4a req-f256b463-da80-4780-a27e-b7bfdd951917 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053481 Aug 31 09:58:35.622017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 535/1059] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:35.938201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:35.939596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:35.946713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.947523 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.948185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.949135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.949865 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.950504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.005588 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:36.006320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:36.006952 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.008185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lazy-loading 'fault' on Instance uuid 46b45063-183f-4c0a-9871-d8cde6966af8 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:36.082216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fca332203b9473fa8b07286bc44300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3cef1ca6964f3dbae8e170ff530811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:36.090590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-39ab2fe6-9d9a-4336-a0fe-9a5c7fdc4126 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 200 len: 1330 microversion: 2.1 time: 0.156843 Aug 31 09:58:36.091167 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 525/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:35 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 1330 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:37.113101 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:37.113811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:37.121262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.121758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.122196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:37.123939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.124405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.124837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:37.140059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 HTTP/1.1 Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:37.141764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:37.143428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '46b45063-183f-4c0a-9871-d8cde6966af8'} Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:37.147737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:37.149270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:37.150641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:37.150641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-08219b93-40aa-47e1-afa9-5cfbb0ca169b tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 404 len: 111 microversion: 2.1 time: 0.034417 Aug 31 09:58:37.150641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 536/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:37 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:37.152073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-33c3efcd-0756-45e0-a92c-d4cb5c6508af tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '.version_select at 0x7f0b5286aaf0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:37.176690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-33c3efcd-0756-45e0-a92c-d4cb5c6508af tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589254390" status: 202 len: 0 microversion: 2.1 time: 0.028363 Aug 31 09:58:37.177315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 526/1062] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 31 09:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589254390 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:58:39.086319 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:39.087645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:39.106658 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.109648 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.110056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.111221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.111925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.112692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.131762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 HTTP/1.1 Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:39.133358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.134940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '46b45063-183f-4c0a-9871-d8cde6966af8'} Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:39.136076 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.138000 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.140231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:39.140231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c33f1e3a-faf9-477a-a071-4c5b8126138d tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 404 len: 111 microversion: 2.1 time: 0.052911 Aug 31 09:58:39.140231 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 537/1063] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:39 2022] DELETE /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:39.143896 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:39.144626 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 46b45063-183f-4c0a-9871-d8cde6966af8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:39.151796 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.152274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.152912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.153818 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.154270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.154689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.168360 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 HTTP/1.1 Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:39.169932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.171398 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '46b45063-183f-4c0a-9871-d8cde6966af8'} Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:39.172663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. Aug 31 09:58:39.174343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.175969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance 46b45063-183f-4c0a-9871-d8cde6966af8 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:39.175969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3f85123e-cf1b-40b2-ac2d-8901cbd372a3 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8" status: 404 len: 111 microversion: 2.1 time: 0.031240 Aug 31 09:58:39.175969 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 527/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:39 2022] GET /compute/v2.1/servers/46b45063-183f-4c0a-9871-d8cde6966af8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:39.592285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c2e1ef1c-4505-4260-9a94-9827b9c5285c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Action: 'create', calling method: .version_select at 0x7f0b527ab4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1148311493"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:39.907095 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c2e1ef1c-4505-4260-9a94-9827b9c5285c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.434541 Aug 31 09:58:39.907742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 538/1065] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Aug 31 09:58:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 09:58:39.920372 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4637ff63-85fa-44e5-be56-74d9b170d9cf tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b528120d0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:39.971629 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4637ff63-85fa-44e5-be56-74d9b170d9cf tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 200 len: 345 microversion: 2.1 time: 0.055061 Aug 31 09:58:39.972270 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 528/1066] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:39 2022] GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:40.350257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:40.350736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:40.357984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.358466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.358896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.359577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.360098 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.360440 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.373970 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e HTTP/1.1 Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:40.375569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.377204 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'd701452f-8a93-4c9c-8225-7a2d1747290e'} Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:40.378078 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.379583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.381325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:40.381325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c34e1874-1424-412c-9c25-34423a9cb246 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 404 len: 111 microversion: 2.1 time: 0.030972 Aug 31 09:58:40.381325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 539/1067] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:40 2022] DELETE /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:40.385891 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:40.386511 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: d701452f-8a93-4c9c-8225-7a2d1747290e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:40.393378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.393735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.394175 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.394870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.395331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.395762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.408694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e HTTP/1.1 Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:40.410252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.411892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'd701452f-8a93-4c9c-8225-7a2d1747290e'} Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:40.412805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. Aug 31 09:58:40.414302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.415608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance d701452f-8a93-4c9c-8225-7a2d1747290e could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:40.415608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f2484d14-a362-4c5a-9f4b-08ddb04ffe49 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e" status: 404 len: 111 microversion: 2.1 time: 0.030131 Aug 31 09:58:40.415608 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 529/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:40 2022] GET /compute/v2.1/servers/d701452f-8a93-4c9c-8225-7a2d1747290e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:40.423393 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:40.423976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:40.430556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.431124 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.431653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.432429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.433006 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.433508 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.447289 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 HTTP/1.1 Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:40.448850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.450914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '30323acf-ca69-4a6a-b55e-2a9e538b59b3'} Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:40.454753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.456196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.458085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:40.458085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-07d936cb-f61e-4bae-a836-99d07a0d08bb tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 404 len: 111 microversion: 2.1 time: 0.034636 Aug 31 09:58:40.458085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 540/1069] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:40 2022] DELETE /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:40.459228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:40.459847 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: 30323acf-ca69-4a6a-b55e-2a9e538b59b3] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:40.466385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.466871 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.467311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.468016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.468477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.468901 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.482458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 HTTP/1.1 Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:40.483999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.485704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '30323acf-ca69-4a6a-b55e-2a9e538b59b3'} Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:40.489751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. Aug 31 09:58:40.491216 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:40.492632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance 30323acf-ca69-4a6a-b55e-2a9e538b59b3 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:40.492632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-370bb0b8-92e3-4e0f-8c5f-522cd2ddcf62 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3" status: 404 len: 111 microversion: 2.1 time: 0.029985 Aug 31 09:58:40.492632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 530/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:40 2022] GET /compute/v2.1/servers/30323acf-ca69-4a6a-b55e-2a9e538b59b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:40.986281 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-14f6c363-bcfa-4c33-b34a-4ab8b525e544 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b52815040>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.038233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-14f6c363-bcfa-4c33-b34a-4ab8b525e544 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 200 len: 346 microversion: 2.1 time: 0.055865 Aug 31 09:58:41.038941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 541/1071] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:40 2022] GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:41.051702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4d571e2f-d023-4424-9124-73c6cedc1004 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Action: 'create', calling method: .version_select at 0x7f0b52643ee0>, body: {"snapshot": {"volume_id": "eb74b424-1294-4c13-9e9d-b2986770ada7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1127926152"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:41.244777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4d571e2f-d023-4424-9124-73c6cedc1004 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.196815 Aug 31 09:58:41.245647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 531/1072] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Aug 31 09:58:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:41.258800 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-54020ecb-5e1c-49c4-bf94-1c3d218729d9 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b527105e0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.300419 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-54020ecb-5e1c-49c4-bf94-1c3d218729d9 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.046877 Aug 31 09:58:41.302056 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 542/1073] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:41 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:41.314668 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-36f6e225-4f14-48e2-9d1f-846867826c32 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b52812b80>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.351760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-36f6e225-4f14-48e2-9d1f-846867826c32 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.040808 Aug 31 09:58:41.352332 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 532/1074] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Aug 31 09:58:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:41.364090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1adcf1e0-ab4c-4243-84d6-7e03ab71bd27 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b527ab820>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.399835 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1adcf1e0-ab4c-4243-84d6-7e03ab71bd27 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.040066 Aug 31 09:58:41.405811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 543/1075] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:41 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:41.634291 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.634762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:41.642355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.642845 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.643486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.644412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.645198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.646036 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.650494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=100 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:41.661099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e HTTP/1.1 Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:41.662669 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.664348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'e5d0bc15-4bb1-46c5-82f5-ad82d487a65e'} Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:41.665524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.667098 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.669931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:41.669931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-067794c1-524b-4da5-9c98-0cf4de8355f2 tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 404 len: 111 microversion: 2.1 time: 0.036043 Aug 31 09:58:41.669931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 533/1076] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:41 2022] DELETE /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:41.675883 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.676506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] [instance: e5d0bc15-4bb1-46c5-82f5-ad82d487a65e] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:41.683294 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.684398 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.685064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.685763 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.686371 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.686788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.709443 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] HTTP exception thrown: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Request method failure captured: Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e HTTP/1.1 Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy4AHmrymfzyM8Zgzw6p3Ao37BqfniP83BW82R1JZc0q1zXdfD6mHaSOtCT7yZ0yPilHCgpe-lVeth6C3u7FWaXWYMwbQNwlkYNzLV4mBgYRLUiYe-hG-OQeMKBExWqi6wS6_9XCJVGAg3ImkFpeBiy3wQzfjlNDQuQqQPRCcrnLRtY Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:41.711133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e3cef1ca6964f3dbae8e170ff530811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e3cef1ca6964f3dbae8e170ff530811", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 1e3cef1ca6964f3dbae8e170ff530811 Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1851884277 Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 0fca332203b9473fa8b07286bc44300f Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-AttachVolumeNegativeTest-1851884277-project Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.712865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'e5d0bc15-4bb1-46c5-82f5-ad82d487a65e'} Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:41.713787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. Aug 31 09:58:41.715269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:41.716475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] Returning 404 to user: Instance e5d0bc15-4bb1-46c5-82f5-ad82d487a65e could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:41.716475 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f4bb6fe3-0682-4248-b32b-3f4f47ba7c9e tempest-AttachVolumeNegativeTest-1851884277 tempest-AttachVolumeNegativeTest-1851884277-project] 10.222.0.25 "GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e" status: 404 len: 111 microversion: 2.1 time: 0.043165 Aug 31 09:58:41.717428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 544/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:41 2022] GET /compute/v2.1/servers/e5d0bc15-4bb1-46c5-82f5-ad82d487a65e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:42.413060 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c97fe177-ba44-43ae-a7a6-36a4143d1c5c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5269a4c0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:42.446530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c97fe177-ba44-43ae-a7a6-36a4143d1c5c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.037210 Aug 31 09:58:42.447637 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 534/1078] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:42 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:43.459819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-01502b5a-1cb7-482c-a184-93ecf665c1cf tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b527105e0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:43.517962 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-01502b5a-1cb7-482c-a184-93ecf665c1cf tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.061892 Aug 31 09:58:43.518534 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 545/1079] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:43 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:44.531400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-54967d91-3500-4a74-ad71-135029fd39c7 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b52574ee0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:44.569139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-54967d91-3500-4a74-ad71-135029fd39c7 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.041643 Aug 31 09:58:44.570156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 535/1080] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:44 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:45.584347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-719baba8-762f-4e98-b264-80d0b382fb99 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b52834f70>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:45.641781 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-719baba8-762f-4e98-b264-80d0b382fb99 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.064212 Aug 31 09:58:45.642903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 546/1081] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:45 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:46.656563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9ae045d2-8f40-46ee-9403-9745176823a8 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5271d0d0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:46.705506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9ae045d2-8f40-46ee-9403-9745176823a8 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.055191 Aug 31 09:58:46.706742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 536/1082] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:46 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:47.718725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-cd9eda3b-a117-4b38-bf8b-635b7fadeebd tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b527aba60>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:47.778923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-cd9eda3b-a117-4b38-bf8b-635b7fadeebd tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 288 microversion: 2.1 time: 0.064161 Aug 31 09:58:47.790698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 547/1083] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:47 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:47.791886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3ddd4218-782b-49fd-bdc7-6eb289bb75f2 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5269ac10>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:47.881956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3ddd4218-782b-49fd-bdc7-6eb289bb75f2 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 202 len: 0 microversion: 2.1 time: 0.094759 Aug 31 09:58:47.884423 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 537/1084] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Aug 31 09:58:47 2022] DELETE /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:47.891856 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8fdf6da4-56ba-4666-a1b6-e1829b242501 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b528c34c0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:47.928107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8fdf6da4-56ba-4666-a1b6-e1829b242501 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 200 len: 287 microversion: 2.1 time: 0.039832 Aug 31 09:58:47.929676 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 548/1085] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:47 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:48.962110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3247aaa7-5710-43d8-8261-c99e8975d09c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5286aee0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:49.042975 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-3247aaa7-5710-43d8-8261-c99e8975d09c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] HTTP exception thrown: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3247aaa7-5710-43d8-8261-c99e8975d09c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Request method failure captured: Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 HTTP/1.1 Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDzDPJYE5tD3LTxLz7viCeXFaKh_st_EE4xxC4CBn66iCeytr-g5qA-NH6z-Nu7enydxwm-qrxMO8wompxR2k_mC86iI4496OA3fRes3trAr7j9U6NLCb8bhRB3z1ckHBqfJUb1XynjTIXoscEbEWxJR2kgjCoCF690gW120oOp38JCk Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:49.051434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b25d6c9e17474409a17d93c188dc3f20", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: d3119d129aec473495bbae2e54cc0177 Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'ba365d43-1307-4f61-a5c0-3ff16b47e357'} Aug 31 09:58:49.053470 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. (HTTP 404) (Request-ID: req-61e68dd5-a7ef-4e96-9db1-747e82d24eda) Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.054541 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:58:49.055759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 09:58:49.057696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. Aug 31 09:58:49.059821 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:49.070856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3247aaa7-5710-43d8-8261-c99e8975d09c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Returning 404 to user: Snapshot ba365d43-1307-4f61-a5c0-3ff16b47e357 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:49.072632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3247aaa7-5710-43d8-8261-c99e8975d09c tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357" status: 404 len: 111 microversion: 2.1 time: 0.118197 Aug 31 09:58:49.075569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 538/1086] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:48 2022] GET /compute/v2.1/os-snapshots/ba365d43-1307-4f61-a5c0-3ff16b47e357 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:49.084971 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d3b277dc-ba41-4be7-9ce0-562551da5558 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5285f430>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:49.240454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d3b277dc-ba41-4be7-9ce0-562551da5558 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 202 len: 0 microversion: 2.1 time: 0.160823 Aug 31 09:58:49.241152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 549/1087] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:58:49 2022] DELETE /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:58:49.250540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a52aa2f3-6388-4a75-9fb9-f89ab5d9d235 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5286ab80>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:49.382035 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a52aa2f3-6388-4a75-9fb9-f89ab5d9d235 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 200 len: 345 microversion: 2.1 time: 0.135698 Aug 31 09:58:49.382967 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 539/1088] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:49 2022] GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:50.401387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1e05644f-7cde-44ad-ab05-2a4636682527 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b536799d0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:50.445735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-1e05644f-7cde-44ad-ab05-2a4636682527 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] HTTP exception thrown: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1e05644f-7cde-44ad-ab05-2a4636682527 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Request method failure captured: Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 HTTP/1.1 Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDzDPJYE5tD3LTxLz7viCeXFaKh_st_EE4xxC4CBn66iCeytr-g5qA-NH6z-Nu7enydxwm-qrxMO8wompxR2k_mC86iI4496OA3fRes3trAr7j9U6NLCb8bhRB3z1ckHBqfJUb1XynjTIXoscEbEWxJR2kgjCoCF690gW120oOp38JCk Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:50.448084 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b25d6c9e17474409a17d93c188dc3f20", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: d3119d129aec473495bbae2e54cc0177 Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'eb74b424-1294-4c13-9e9d-b2986770ada7'} Aug 31 09:58:50.449909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. (HTTP 404) (Request-ID: req-95ee27bc-39a3-4be8-bc73-52e9d3189a5f) Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.450857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:58:50.452257 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:58:50.453671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.455481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.459140 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-1e05644f-7cde-44ad-ab05-2a4636682527 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Returning 404 to user: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:50.460575 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-1e05644f-7cde-44ad-ab05-2a4636682527 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 404 len: 109 microversion: 2.1 time: 0.067481 Aug 31 09:58:50.461818 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 550/1089] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:50 2022] GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:50.474319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-627fe7c6-81ba-4424-981f-36e546c54d73 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b5269ac10>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:50.510018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-627fe7c6-81ba-4424-981f-36e546c54d73 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] HTTP exception thrown: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-627fe7c6-81ba-4424-981f-36e546c54d73 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Request method failure captured: Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: DELETE /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 HTTP/1.1 Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDzDPJYE5tD3LTxLz7viCeXFaKh_st_EE4xxC4CBn66iCeytr-g5qA-NH6z-Nu7enydxwm-qrxMO8wompxR2k_mC86iI4496OA3fRes3trAr7j9U6NLCb8bhRB3z1ckHBqfJUb1XynjTIXoscEbEWxJR2kgjCoCF690gW120oOp38JCk Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 09:58:50.517219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b25d6c9e17474409a17d93c188dc3f20", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: d3119d129aec473495bbae2e54cc0177 Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': 'eb74b424-1294-4c13-9e9d-b2986770ada7'} Aug 31 09:58:50.519039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. (HTTP 404) (Request-ID: req-b6282398-3b13-4912-bf2a-7a9b37e84c52) Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.520009 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:58:50.521431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:58:50.522736 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.524086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-627fe7c6-81ba-4424-981f-36e546c54d73 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Returning 404 to user: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:50.525026 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-627fe7c6-81ba-4424-981f-36e546c54d73 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 404 len: 109 microversion: 2.1 time: 0.056225 Aug 31 09:58:50.530090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 540/1090] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 31 09:58:50 2022] DELETE /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:50.535280 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-edd68c66-5713-44f2-af58-f54d355c6487 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Calling method '.version_select at 0x7f0b527ab700>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:50.571441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-edd68c66-5713-44f2-af58-f54d355c6487 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] HTTP exception thrown: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-edd68c66-5713-44f2-af58-f54d355c6487 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Request method failure captured: Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 HTTP/1.1 Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDzDPJYE5tD3LTxLz7viCeXFaKh_st_EE4xxC4CBn66iCeytr-g5qA-NH6z-Nu7enydxwm-qrxMO8wompxR2k_mC86iI4496OA3fRes3trAr7j9U6NLCb8bhRB3z1ckHBqfJUb1XynjTIXoscEbEWxJR2kgjCoCF690gW120oOp38JCk Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 09:58:50.573704 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b25d6c9e17474409a17d93c188dc3f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b25d6c9e17474409a17d93c188dc3f20", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: b25d6c9e17474409a17d93c188dc3f20 Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481353402 Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: d3119d129aec473495bbae2e54cc0177 Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481353402-project Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'eb74b424-1294-4c13-9e9d-b2986770ada7'} Aug 31 09:58:50.575401 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. (HTTP 404) (Request-ID: req-69c0c06d-c9ff-4c90-a1c5-ce95ea98f33f) Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.576550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:58:50.577998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:58:50.579399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 09:58:50.580787 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-edd68c66-5713-44f2-af58-f54d355c6487 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] Returning 404 to user: Volume eb74b424-1294-4c13-9e9d-b2986770ada7 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:50.581872 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-edd68c66-5713-44f2-af58-f54d355c6487 tempest-VolumesSnapshotsTestJSON-1481353402 tempest-VolumesSnapshotsTestJSON-1481353402-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7" status: 404 len: 109 microversion: 2.1 time: 0.049752 Aug 31 09:58:50.582729 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 551/1091] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:50 2022] GET /compute/v2.1/os-volumes/eb74b424-1294-4c13-9e9d-b2986770ada7 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:56.210471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a20cab11-e4d7-432d-8d73-0834b5ce0d5e tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b526d1f70>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:56.228826 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:56.236555 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:56.314713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a20cab11-e4d7-432d-8d73-0834b5ce0d5e tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e6fdd0de-ee7d-4b29-9eb2-a53d2e89c7e8" status: 200 len: 351 microversion: 2.1 time: 0.108944 Aug 31 09:58:56.316322 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 541/1092] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:56 2022] GET /compute/v2.1/os-volumes/e6fdd0de-ee7d-4b29-9eb2-a53d2e89c7e8 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:57.823359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-70d60591-df85-4cd2-8b1c-881c0ee3c4cb tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b527aba60>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:57.831458 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:57.832403 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=16 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:57.882376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-70d60591-df85-4cd2-8b1c-881c0ee3c4cb tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/03ff4bde-c16e-421c-9d44-21da8a9d001c" status: 200 len: 351 microversion: 2.1 time: 0.068279 Aug 31 09:58:57.882949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 552/1093] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:58:57 2022] GET /compute/v2.1/os-volumes/03ff4bde-c16e-421c-9d44-21da8a9d001c => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:00.401258 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-407167ef-f0ce-48d1-bd9a-a92674970cf4 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b52574c10>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.463108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-407167ef-f0ce-48d1-bd9a-a92674970cf4 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/aa9501cb-c0f0-4bf7-9f7d-ca82328c1c1a" status: 200 len: 351 microversion: 2.1 time: 0.066945 Aug 31 09:59:00.464176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 542/1094] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/os-volumes/aa9501cb-c0f0-4bf7-9f7d-ca82328c1c1a => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:00.476688 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8c10f707-1690-4737-a80c-25f135037db3 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b527e4280>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.567197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8c10f707-1690-4737-a80c-25f135037db3 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.093461 Aug 31 09:59:00.568353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 553/1095] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:00.582494 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ffea7181-1530-4c41-a1d0-3ada48fe1083 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b5286ab80>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.677649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ffea7181-1530-4c41-a1d0-3ada48fe1083 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.099077 Aug 31 09:59:00.678598 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 543/1096] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:00.691427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a1063f48-6532-41c8-9633-8e05a5e59adb tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b52741e50>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.781498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-85123ea5-dddd-4fb5-a46e-d6276f360e66 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Action: 'create', calling method: .version_select at 0x7f0b528399d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1058081237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhjtSPEc4TK2KBHDoT8UQeUlE0eGFOg4R1AEp3Lo+nTIbcm82GmpWEKcJ52Uw1IXsTkbPRvVAKstH3PUbu/H6exCd82fDCaEpEBScCf912ZHikzkfqFohPDGrYJXbpByg=="}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:00.786473 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a1063f48-6532-41c8-9633-8e05a5e59adb tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.098729 Aug 31 09:59:00.794539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 554/1097] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:00.798603 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-85123ea5-dddd-4fb5-a46e-d6276f360e66 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Getting quotas for project df7a0ee4a83f48d78f1c941172cacdb9. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:59:00.800256 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-788a0ed1-e419-423b-986e-c322a35dc720 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b528b0ee0>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.802843 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-85123ea5-dddd-4fb5-a46e-d6276f360e66 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Getting quotas for user 633f1828cf87496fbc0dad682bf9986b and project df7a0ee4a83f48d78f1c941172cacdb9. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:59:00.827604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-85123ea5-dddd-4fb5-a46e-d6276f360e66 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050144 Aug 31 09:59:00.828819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 544/1098] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 09:59:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:00.885035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-788a0ed1-e419-423b-986e-c322a35dc720 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088749 Aug 31 09:59:00.885605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 555/1099] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:00.905961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a7cbd857-0c1a-49d7-9e6f-8e810962e881 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b52839ca0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.950565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-527320291", "imageRef": "c2990870-65b7-4562-9395-392dee98fa33", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1058081237", "networks": [{"uuid": "b15f2fb8-4253-4233-bbf4-7fe49982a788"}]}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:00.991290 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a7cbd857-0c1a-49d7-9e6f-8e810962e881 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.095731 Aug 31 09:59:00.991894 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 545/1100] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:01.007201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dc4d5ac5-af51-4764-81a4-87327141c686 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b5269ad30>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.019526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] validate_networks() for [('b15f2fb8-4253-4233-bbf4-7fe49982a788', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:59:01.114327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dc4d5ac5-af51-4764-81a4-87327141c686 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.110924 Aug 31 09:59:01.115159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 546/1101] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:01.129724 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6ad533bb-c0ef-4a07-9efd-bbd081722c0b tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b52889820>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.217990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6ad533bb-c0ef-4a07-9efd-bbd081722c0b tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092893 Aug 31 09:59:01.218660 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 547/1102] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:01.236978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-62eea250-83df-4252-a10e-c32c5ebca566 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] Calling method '.version_select at 0x7f0b528893a0>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.321884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-62eea250-83df-4252-a10e-c32c5ebca566 tempest-VolumesTestJSON-843831803 tempest-VolumesTestJSON-843831803-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088662 Aug 31 09:59:01.322458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 548/1103] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:01.817621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:59:01.818071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:59:01.818498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:59:01.818927 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:59:01.819342 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:59:01.828825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.829366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.829804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.830582 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.831031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.831434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.850583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Getting quotas for project df7a0ee4a83f48d78f1c941172cacdb9. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:59:01.854751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Getting quotas for user 633f1828cf87496fbc0dad682bf9986b and project df7a0ee4a83f48d78f1c941172cacdb9. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:59:01.865578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:59:01.867815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2990870-65b7-4562-9395-392dee98fa33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:59:01.917356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fc9f2c2d-b355-4639-9cad-74f07ecd0e63 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971349 Aug 31 09:59:01.918340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 556/1104] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:59:01.929469 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-aa590776-db29-4605-880f-3284efd06440 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.930648 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-aa590776-db29-4605-880f-3284efd06440 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:01.994114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-aa590776-db29-4605-880f-3284efd06440 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:02.001680 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-aa590776-db29-4605-880f-3284efd06440 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1258 microversion: 2.1 time: 0.076800 Aug 31 09:59:02.002399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 549/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:03.023414 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:03.024021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:03.031737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:03.032220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:03.032753 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.033539 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:03.034017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:03.034454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.097378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:03.105050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f5a52a80-ffe8-429a-982b-0bf1f72621ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1310 microversion: 2.1 time: 0.085987 Aug 31 09:59:03.105613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 557/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:03 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:04.130387 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:04.131529 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:04.164722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.166090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.166609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.168390 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.169279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.170079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.439697 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:04.450146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b2920ec7-39c3-45c6-bc0e-1ac6bd974f5d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.326940 Aug 31 09:59:04.451125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 550/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:04 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:05.474931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:05.475847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:05.490975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:05.496673 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:05.497383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.498276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:05.498999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:05.500904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.772625 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:05.782811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-62d7d5ea-8d3f-46b0-b382-4962b7d7bbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.314612 Aug 31 09:59:05.783395 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 558/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:05 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:06.807984 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:06.808642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:06.816370 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.817332 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.817776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:06.819111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.827690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.829376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:07.026750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:07.040559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-694b9873-cc3a-4ad2-8d23-287d663cc36d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.237703 Aug 31 09:59:07.041922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 551/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:06 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:08.065763 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:08.067254 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:08.082950 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.085269 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.087972 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.089181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.091771 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.093360 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.390934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:08.405077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4bf444ed-a5df-4fd0-b8ae-d0c2d984cb71 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.344925 Aug 31 09:59:08.419365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 559/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:08 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:09.428599 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:09.429284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:09.437242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.437734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.438172 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.438876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.439329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.439750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.593013 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:09.602519 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0ae9832c-4215-404a-8be6-a49a5cc40a62 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.179054 Aug 31 09:59:09.603463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 552/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:09 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:10.623681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:10.624357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:10.631271 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.631768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.632219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.632933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.633674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.634094 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.878723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:10.890072 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2558b01c-cab8-429a-b262-dee4a52afbc4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.270775 Aug 31 09:59:10.891217 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 560/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:10 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:11.040974 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-456467122", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "networks": [{"uuid": "b284f934-c11c-4c4d-937f-56eda9e00de3"}]}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:11.131883 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] validate_networks() for [('b284f934-c11c-4c4d-937f-56eda9e00de3', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:59:11.756503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:59:11.756922 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:59:11.757433 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:59:11.758038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:59:11.758759 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:59:11.769129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.769936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.770535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.771471 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.772261 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.773099 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.793019 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Getting quotas for project 652969f53c4746f0ac3e06c2bf0783cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:59:11.797132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Getting quotas for user dd065f00c6554be59c75671de39bd1b7 and project 652969f53c4746f0ac3e06c2bf0783cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:59:11.808824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:59:11.811146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:59:11.858208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6a36543a-0e46-439a-b228-ec5ad1a2aef3 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821921 Aug 31 09:59:11.859185 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 553/1113] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 09:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:59:11.870029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6872d114-fb11-4f94-b2a7-62efff4b6e1a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:11.870720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6872d114-fb11-4f94-b2a7-62efff4b6e1a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:11.880068 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:11.886198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:11.911912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:11.912565 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:11.939899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.945702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.946169 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.947014 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.947479 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.947939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.995272 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6872d114-fb11-4f94-b2a7-62efff4b6e1a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:12.022264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6872d114-fb11-4f94-b2a7-62efff4b6e1a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1218 microversion: 2.1 time: 0.156264 Aug 31 09:59:12.028077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 561/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:11 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:12.218375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:12.242672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5a87f381-7226-4942-bfa2-d639c90a5850 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.334439 Aug 31 09:59:12.243696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 554/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:11 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:13.044988 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:13.046255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:13.075348 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.075862 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.076301 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.077041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.077502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.077925 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.148636 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:13.164775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-231664a7-8eb3-479b-ac0c-bbc12214c80d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1222 microversion: 2.1 time: 0.123536 Aug 31 09:59:13.165450 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 562/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:13 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:13.264274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:13.264886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:13.272257 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.273252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.273932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.275008 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.275540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.276633 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.514878 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:13.523451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-59922454-1b42-4e58-8b93-4d1dff3aaa1a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.263524 Aug 31 09:59:13.524492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 555/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:13 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:14.185923 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:14.186545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:14.192973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.193483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.193921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.194617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.195074 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.195502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.266226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:14.278106 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3c850792-4001-486e-bd63-dc64bcdce3f5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1222 microversion: 2.1 time: 0.096008 Aug 31 09:59:14.278681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 563/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:14 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:14.544255 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:14.544868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:14.551291 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.551775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.552206 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.553181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.553639 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.554065 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.679465 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:14.687754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-15f0ed02-e4e2-4353-87a6-b0755088c268 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.147480 Aug 31 09:59:14.688314 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 556/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:14 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:15.309035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:15.309655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:15.316248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.316744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.317222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.317920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.318379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.318809 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.379527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:15.387035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ea76de5d-5e1a-46d1-a979-74109aa453d9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1222 microversion: 2.1 time: 0.082405 Aug 31 09:59:15.387592 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 564/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:15 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:15.707917 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:15.708664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:15.715507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.716007 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.716445 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.717165 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.717617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.718034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.850898 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:15.859109 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fd5e9d7a-0b81-495b-bc75-5555da676c9b tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.155336 Aug 31 09:59:15.859685 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 557/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:15 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:16.406903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:16.407464 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:16.414058 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.414544 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.414980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.415671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.416620 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.417071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.479405 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:16.487378 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8024a89b-dac1-476d-9b26-5b4a59aebf46 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1222 microversion: 2.1 time: 0.084394 Aug 31 09:59:16.487945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 565/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:16 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:16.879546 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:16.880158 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:16.886981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.887464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.887888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.888569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.889051 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.889473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.026657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.035075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-72de9d6e-177f-4743-b086-579588907b96 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.159339 Aug 31 09:59:17.048275 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 558/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:16 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:17.507929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:17.508537 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:17.515292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.515774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.516208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.516896 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.517376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.517805 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.581002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.588634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3381b5f2-1cdc-4cd9-8cbb-20ff683eebf0 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1222 microversion: 2.1 time: 0.084626 Aug 31 09:59:17.589236 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 566/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:17 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:18.055548 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:18.056331 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:18.062681 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.063102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.063533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.064212 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.064658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.065102 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.195094 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:18.203038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-66814942-f99f-4cb2-9a3f-ea24cd0bd0f5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.151231 Aug 31 09:59:18.203569 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 559/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:18 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:18.609372 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:18.609920 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:18.616167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.616655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.617121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.617826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.618284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.618709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.715740 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:18.724282 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-572d9632-32c3-46a0-b113-f7efa5e50fa5 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1270 microversion: 2.1 time: 0.119016 Aug 31 09:59:18.724850 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 567/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:18 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:18.953923 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-eb82861e-0eca-4726-97c4-599c4114b869 req-a2dff5c2-c795-4f8d-ac03-0ee0ef9100b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:18.964050 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-eb82861e-0eca-4726-97c4-599c4114b869 req-a2dff5c2-c795-4f8d-ac03-0ee0ef9100b1 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.964550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-eb82861e-0eca-4726-97c4-599c4114b869 req-a2dff5c2-c795-4f8d-ac03-0ee0ef9100b1 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.964991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-eb82861e-0eca-4726-97c4-599c4114b869 req-a2dff5c2-c795-4f8d-ac03-0ee0ef9100b1 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.976347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-eb82861e-0eca-4726-97c4-599c4114b869 req-a2dff5c2-c795-4f8d-ac03-0ee0ef9100b1 service nova] Creating event network-changed:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 09:59:18.982063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-eb82861e-0eca-4726-97c4-599c4114b869 req-a2dff5c2-c795-4f8d-ac03-0ee0ef9100b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031762 Aug 31 09:59:18.982832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 560/1127] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:19.224534 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.225452 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:19.232810 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.233507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.234065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.235518 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.236527 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.237227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.477374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.485343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2e3cce92-0146-473b-998d-90675d6236d8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.266402 Aug 31 09:59:19.486163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 568/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:19.747184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.748097 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:19.754776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.755401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.755961 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.756742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.757242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.757735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.854727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.862695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-764c7444-3c7f-4d3d-9861-2955345f677d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1276 microversion: 2.1 time: 0.120913 Aug 31 09:59:19.863590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 561/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:20.506743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:20.507354 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:20.515718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.516209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.517042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.517754 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.518213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.518654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.661583 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.671490 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e948433c-b586-473b-8e3c-6343f5fc7c35 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.168317 Aug 31 09:59:20.686491 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 569/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:20 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:20.865271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-d5c994cd-9cf4-4612-b51f-89ac45341236 req-62ab4bf1-721c-434d-b6a3-74fbe192829b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8cc53d-ab70-47b4-be45-d9e0cbb79514", "tag": "f10055e3-7f1b-4085-9785-77d1f109b496"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:20.875956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d5c994cd-9cf4-4612-b51f-89ac45341236 req-62ab4bf1-721c-434d-b6a3-74fbe192829b service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.876426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d5c994cd-9cf4-4612-b51f-89ac45341236 req-62ab4bf1-721c-434d-b6a3-74fbe192829b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.876850 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d5c994cd-9cf4-4612-b51f-89ac45341236 req-62ab4bf1-721c-434d-b6a3-74fbe192829b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.884771 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:20.885406 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:20.888483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-d5c994cd-9cf4-4612-b51f-89ac45341236 req-62ab4bf1-721c-434d-b6a3-74fbe192829b service nova] Creating event network-changed:f10055e3-7f1b-4085-9785-77d1f109b496 for instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 on hv-cinder-83754 Aug 31 09:59:20.891337 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.891823 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.892270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.892974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.893264 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-d5c994cd-9cf4-4612-b51f-89ac45341236 req-62ab4bf1-721c-434d-b6a3-74fbe192829b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186254 Aug 31 09:59:20.893441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.893846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 562/1131] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:20.893945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.021501 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:21.029618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-96d0616d-9d26-471e-b85c-9d961ad11d3c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.148837 Aug 31 09:59:21.030184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 570/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:20 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:21.693800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:21.694528 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:21.701209 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.701691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.702125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.702811 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.703266 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.703694 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.785946 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:21.805489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=12 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:21.837689 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:21.845918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1a259c75-b0ba-4032-9804-80daa93afa59 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.156380 Aug 31 09:59:21.846587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 563/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:21 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:22.050846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:22.051467 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:22.054819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:22.061177 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.061668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.062186 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.063066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.063722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.064333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.198634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:22.206184 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0d27af6d-bcff-4f8d-a58f-a6db8439f58d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.159202 Aug 31 09:59:22.206745 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 571/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:22 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:22.866653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:22.867197 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:22.873634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.874106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.874535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.875218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.875665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.876080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:23.226723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:23.227427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:23.235602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:23.236212 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:23.236891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:23.237595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:23.238150 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:23.238600 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:23.256364 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:23.270591 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e31e473f-6b7c-4190-ae0c-fe96e4d21ed5 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.407774 Aug 31 09:59:23.271658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 564/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:22 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:23.406718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:23.414891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9794bb10-8755-4be7-8d2c-31f7763d823b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.191943 Aug 31 09:59:23.415462 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 572/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:23 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:24.295412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:24.296602 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:24.303187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:24.303659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:24.304086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:24.304767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:24.305240 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:24.305658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:24.434149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:24.437365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:24.438052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:24.442235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ce7d359c-6375-474a-af55-b5a77f615176 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.151257 Aug 31 09:59:24.443078 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 565/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:24 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:24.455837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:24.456393 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:24.456778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:24.457535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:24.457999 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:24.458430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:24.595994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:24.603788 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-df54c1ec-9cf6-4545-8799-2c9d8b0716f4 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.171729 Aug 31 09:59:24.604364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 573/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:24 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:25.464272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:25.464815 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:25.471464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:25.471942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:25.472371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:25.473087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:25.473542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:25.473967 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:25.608979 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:25.616544 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4bc55106-91e6-49ae-b82d-d0dfb8529fea tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.156761 Aug 31 09:59:25.617145 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 566/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:25 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:25.623678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:25.624288 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:25.630865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:25.631349 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:25.631783 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:25.632474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:25.632927 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:25.633381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:25.637365 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=100 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:25.766739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:25.774854 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2c3489fe-98b5-4122-b57d-06014da4a402 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.154969 Aug 31 09:59:25.775890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 574/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:25 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:26.637790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:26.638334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:26.640649 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:26.646371 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:26.646858 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:26.647298 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:26.647993 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:26.648452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:26.648883 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:26.653992 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=91 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:26.774741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:26.782912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-da81fac8-8f7d-44ef-8fe7-2e97e0982719 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.149678 Aug 31 09:59:26.783477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 567/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:26 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:26.795554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:26.796159 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:26.802863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:26.803339 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:26.803767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:26.804445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:26.804890 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:26.805341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:26.931333 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:26.939616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-cb7206a3-23ef-4b21-8b31-1bb02d2750ce tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.147904 Aug 31 09:59:26.940345 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 575/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:26 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:27.146545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-a12272a2-4094-4bdb-8120-f4d6faba158d req-1019d023-ec0f-423e-814b-e12821d79126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "name": "network-vif-plugged", "status": "completed", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:27.165409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a12272a2-4094-4bdb-8120-f4d6faba158d req-1019d023-ec0f-423e-814b-e12821d79126 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.165409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a12272a2-4094-4bdb-8120-f4d6faba158d req-1019d023-ec0f-423e-814b-e12821d79126 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.165409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a12272a2-4094-4bdb-8120-f4d6faba158d req-1019d023-ec0f-423e-814b-e12821d79126 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:27.168570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-a12272a2-4094-4bdb-8120-f4d6faba158d req-1019d023-ec0f-423e-814b-e12821d79126 service nova] Creating event network-vif-plugged:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 09:59:27.173844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-a12272a2-4094-4bdb-8120-f4d6faba158d req-1019d023-ec0f-423e-814b-e12821d79126 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091098 Aug 31 09:59:27.174723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 568/1143] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:27.803696 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:27.804313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:27.810978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.811465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.811909 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:27.812617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.813102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.813577 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:27.943444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:27.951103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f80b0488-642e-4b33-96d2-ad1f86bba833 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.151601 Aug 31 09:59:27.951666 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 576/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:27 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:27.961999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:27.963400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:27.969622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.970130 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.970550 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:27.971241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.971699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.972125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:28.142119 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:28.149687 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d7dfa2f5-67f6-43da-af61-9db5d3bc58ca tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.192490 Aug 31 09:59:28.150814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 569/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:27 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:28.973595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:28.974989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:28.982907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:28.985722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:28.986413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:28.987017 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:28.988764 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:28.990041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:28.990634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:29.171604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:29.172477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:29.183173 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:29.184276 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:29.184844 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:29.185630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:29.186173 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:29.186662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:29.209492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:29.218499 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-25ff7be2-76b2-4a89-b65c-8e7179e9a879 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1358 microversion: 2.1 time: 0.248999 Aug 31 09:59:29.230481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 577/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:28 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:29.321237 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:29.330582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1a32ea08-671d-455a-92e2-23ff80b4e038 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.162971 Aug 31 09:59:29.331236 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 570/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:29 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:30.240167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.241012 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:30.248276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.248894 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.249429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.250193 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.250870 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.251368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.355184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.356349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:30.362647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.363217 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.363579 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.364907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.365404 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.365840 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.392215 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:30.400751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-cffa2b27-f979-4787-bbc7-fb36fea6be18 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1547 microversion: 2.1 time: 0.164953 Aug 31 09:59:30.401670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 578/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:30.422036 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.422666 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:30.430114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.430613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.431713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.432742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.433277 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.433865 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.509688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:30.517720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9ad768c1-0875-4282-a789-6be8c9b12d8d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.166805 Aug 31 09:59:30.518620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 571/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:30.578625 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:30.586914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7c80bbab-08aa-4a9e-82e2-1c9e415b9218 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1547 microversion: 2.1 time: 0.169501 Aug 31 09:59:30.587601 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 579/1150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:30.607357 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.612114 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:30.612873 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Searching by: {'deleted': False, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9'} {{(pid=132478) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 09:59:30.620139 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.620798 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.621464 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.622334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.622956 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.623693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.721986 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.multi_cell_list [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 09:59:30.821942 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-9abc91f0-89f6-406e-9561-c1397e02eec9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218981 Aug 31 09:59:30.822533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 572/1151] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:30.834827 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.835629 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:30.846437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.847224 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.848065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.848786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.849297 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.849891 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.994007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:31.002126 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0b598ad1-8cf6-4aae-83fb-3e1b31e395c4 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1547 microversion: 2.1 time: 0.171872 Aug 31 09:59:31.002686 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 580/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:31.269259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-bc85c2c3-b934-4670-9043-41b8807a702b req-098abaa4-b25f-4fb0-8f0c-27b334d51495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8cc53d-ab70-47b4-be45-d9e0cbb79514", "name": "network-vif-plugged", "status": "completed", "tag": "f10055e3-7f1b-4085-9785-77d1f109b496"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:31.281085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-bc85c2c3-b934-4670-9043-41b8807a702b req-098abaa4-b25f-4fb0-8f0c-27b334d51495 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:31.282147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-bc85c2c3-b934-4670-9043-41b8807a702b req-098abaa4-b25f-4fb0-8f0c-27b334d51495 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:31.282851 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-bc85c2c3-b934-4670-9043-41b8807a702b req-098abaa4-b25f-4fb0-8f0c-27b334d51495 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:31.295324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-bc85c2c3-b934-4670-9043-41b8807a702b req-098abaa4-b25f-4fb0-8f0c-27b334d51495 service nova] Creating event network-vif-plugged:f10055e3-7f1b-4085-9785-77d1f109b496 for instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 on hv-cinder-83754 Aug 31 09:59:31.316358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-bc85c2c3-b934-4670-9043-41b8807a702b req-098abaa4-b25f-4fb0-8f0c-27b334d51495 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053309 Aug 31 09:59:31.319874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 573/1153] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:31.537982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:31.538678 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:31.545656 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:31.546450 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:31.546936 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:31.547650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:31.548110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:31.548540 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:31.707569 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:31.718744 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-588f773d-7d9f-4f79-8f34-4ce35bf63b13 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.184533 Aug 31 09:59:31.719381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 581/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:31 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:32.741665 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:32.742358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:32.749058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:32.749544 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:32.749978 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:32.750657 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:32.751282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:32.751727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:32.891189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:32.898772 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bcaf816f-a9b9-405d-bca4-853556df3f45 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.162934 Aug 31 09:59:32.899341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 574/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:32 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:33.658853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c96e657-965b-4bb2-b33f-13766f695e0c"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:33.661313 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:33.667897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.668388 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.668821 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.669541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.669997 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.670419 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.919810 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:33.920402 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:33.926860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.927722 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.928166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.928872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.929361 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.929788 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:34.063870 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:34.072214 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ee385d00-817f-4105-9554-c83ba17ea625 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1318 microversion: 2.1 time: 0.155551 Aug 31 09:59:34.073365 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 575/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:33 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:34.368065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8583812f-8058-4d92-a2b5-52390cda75a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712981 Aug 31 09:59:34.369374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 582/1157] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 09:59:33 2022] POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:35.094747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:35.095353 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:35.101719 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:35.102230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:35.102713 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:35.103394 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:35.103841 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:35.104259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:35.231041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:35.238804 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e4d9a531-3c61-4231-9b0d-631402c53fe6 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1506 microversion: 2.1 time: 0.147813 Aug 31 09:59:35.239416 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 576/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:35 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:43.101714 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:43.103238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:43.110016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:43.110513 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:43.110960 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:43.111915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:43.112376 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:43.112809 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:43.251791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:43.260680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7d118f48-8828-4df5-990a-a812f7496de2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1593 microversion: 2.1 time: 0.164171 Aug 31 09:59:43.261436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 583/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:43 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:45.054179 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-553e7e8f-f2f6-4002-b6d3-a565722c95a8 req-9faaf10f-7846-4041-bced-6550dde8a3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:45.068190 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:45.082792 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-553e7e8f-f2f6-4002-b6d3-a565722c95a8 req-9faaf10f-7846-4041-bced-6550dde8a3c1 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:45.091881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-553e7e8f-f2f6-4002-b6d3-a565722c95a8 req-9faaf10f-7846-4041-bced-6550dde8a3c1 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:45.092062 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-553e7e8f-f2f6-4002-b6d3-a565722c95a8 req-9faaf10f-7846-4041-bced-6550dde8a3c1 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:45.104560 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-553e7e8f-f2f6-4002-b6d3-a565722c95a8 req-9faaf10f-7846-4041-bced-6550dde8a3c1 service nova] Creating event network-changed:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 09:59:45.110476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-553e7e8f-f2f6-4002-b6d3-a565722c95a8 req-9faaf10f-7846-4041-bced-6550dde8a3c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060259 Aug 31 09:59:45.116131 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 577/1160] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:46.334853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-566419876"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:46.336163 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:46.370550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:46.373924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:46.374357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:46.375080 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:46.375529 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:46.375948 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:46.509811 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.network.security_group_api [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Adding security group 5fd6fee5-81cb-4545-a9a7-5c524d937a70 to port 38507c74-1bb4-4d21-82bb-9017585156a0 Aug 31 09:59:46.821618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ef1c2499-149b-496c-b304-9ec97891b567 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/action" status: 202 len: 0 microversion: 2.1 time: 0.490224 Aug 31 09:59:46.822282 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 584/1161] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 09:59:46 2022] POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:59:46.831155 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:46.831925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:46.838030 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:46.838507 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:46.838935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:46.839623 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:46.840067 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:46.840484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:46.987745 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:46.996536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e69c9bf2-584a-4fb8-9865-3b41c300d057 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1758 microversion: 2.1 time: 0.169987 Aug 31 09:59:46.997153 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 578/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:46 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:47.127366 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-15bd44d5-e83e-4541-8bfc-a9cc643ae986 req-db7b2ec9-0ae3-4c76-835e-1554dd8147ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:47.141244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-15bd44d5-e83e-4541-8bfc-a9cc643ae986 req-db7b2ec9-0ae3-4c76-835e-1554dd8147ef service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:47.141730 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-15bd44d5-e83e-4541-8bfc-a9cc643ae986 req-db7b2ec9-0ae3-4c76-835e-1554dd8147ef service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:47.142158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-15bd44d5-e83e-4541-8bfc-a9cc643ae986 req-db7b2ec9-0ae3-4c76-835e-1554dd8147ef service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:47.153232 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-15bd44d5-e83e-4541-8bfc-a9cc643ae986 req-db7b2ec9-0ae3-4c76-835e-1554dd8147ef service nova] Creating event network-changed:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 09:59:47.158018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-15bd44d5-e83e-4541-8bfc-a9cc643ae986 req-db7b2ec9-0ae3-4c76-835e-1554dd8147ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034793 Aug 31 09:59:47.158899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 585/1163] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:55.894627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:55.895182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:55.896774 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-01a935ea-5d90-4834-a8bc-107a53409afa req-2634c33a-1cd6-40ba-9fa2-2316cf6cdc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6e2576-b7f0-40bf-adec-2fcb59ed5467", "tag": "0aede022-4468-4a55-88f1-cf33e1c27f70"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:55.902467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:55.902985 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:55.903514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:55.904435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:55.905104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:55.905530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:55.907639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-01a935ea-5d90-4834-a8bc-107a53409afa req-2634c33a-1cd6-40ba-9fa2-2316cf6cdc25 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:55.908211 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-01a935ea-5d90-4834-a8bc-107a53409afa req-2634c33a-1cd6-40ba-9fa2-2316cf6cdc25 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:55.909052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-01a935ea-5d90-4834-a8bc-107a53409afa req-2634c33a-1cd6-40ba-9fa2-2316cf6cdc25 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:55.920393 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:55.923851 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-01a935ea-5d90-4834-a8bc-107a53409afa req-2634c33a-1cd6-40ba-9fa2-2316cf6cdc25 service nova] Creating event network-changed:0aede022-4468-4a55-88f1-cf33e1c27f70 for instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 on hv-cinder-83754 Aug 31 09:59:55.931347 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-01a935ea-5d90-4834-a8bc-107a53409afa req-2634c33a-1cd6-40ba-9fa2-2316cf6cdc25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039406 Aug 31 09:59:55.932623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 586/1164] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:55.934643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:59:56.014231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5d08f429-6dd6-4fa6-b989-944e77c193ae tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 204 len: 0 microversion: 2.1 time: 0.123393 Aug 31 09:59:56.014819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 579/1165] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:55 2022] DELETE /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:59:56.025325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:56.026334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:56.033524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.034020 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.034653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.035532 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.036143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.036723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.180946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:56.188581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-389f902b-cf2b-4575-818b-cd0c93af1ef2 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1576 microversion: 2.1 time: 0.168257 Aug 31 09:59:56.189411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 587/1166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:56 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:57.211005 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:57.212121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:57.214677 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:57.219968 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.220453 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.220890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.221604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.222088 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.222539 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.230223 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:57.362748 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:57.370456 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-69997dcf-51aa-4d9d-bff9-93d8180b90b8 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1576 microversion: 2.1 time: 0.163769 Aug 31 09:59:57.371023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 580/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:57 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:58.391939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:58.392545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:58.399640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:58.400132 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:58.400565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:58.401302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:58.401756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:58.402176 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:58.546111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:58.554523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c4a8b2a2-eb2d-4acd-83dd-6464544cab8f tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1458 microversion: 2.1 time: 0.166563 Aug 31 09:59:58.555104 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 588/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:58 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:59.575791 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:59.576396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:59.582641 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:59.583125 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:59.583653 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:59.584341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:59.584794 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:59.585248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:59.815324 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:59.823174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2512bf3b-f465-4a50-9c28-ef587bb229ed tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1458 microversion: 2.1 time: 0.251153 Aug 31 09:59:59.823763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 581/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:59 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1458 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:00.055556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-ae883332-524a-4690-b82d-e8ab69df5c45 req-6939b908-07a4-4a12-93df-bbfc527387bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6e2576-b7f0-40bf-adec-2fcb59ed5467", "name": "network-vif-deleted", "tag": "0aede022-4468-4a55-88f1-cf33e1c27f70"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:00.061351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=24 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:00.067353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ae883332-524a-4690-b82d-e8ab69df5c45 req-6939b908-07a4-4a12-93df-bbfc527387bb service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:00.067832 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ae883332-524a-4690-b82d-e8ab69df5c45 req-6939b908-07a4-4a12-93df-bbfc527387bb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:00.068264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-ae883332-524a-4690-b82d-e8ab69df5c45 req-6939b908-07a4-4a12-93df-bbfc527387bb service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:00.079706 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-ae883332-524a-4690-b82d-e8ab69df5c45 req-6939b908-07a4-4a12-93df-bbfc527387bb service nova] Creating event network-vif-deleted:0aede022-4468-4a55-88f1-cf33e1c27f70 for instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 on hv-cinder-83754 Aug 31 10:00:00.085143 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-ae883332-524a-4690-b82d-e8ab69df5c45 req-6939b908-07a4-4a12-93df-bbfc527387bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Aug 31 10:00:00.086667 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 589/1170] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:00.843552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:00.844160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:00.849999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:00.850484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:00.850920 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:00.851614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:00.852070 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:00.852496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:00.882167 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:00.883201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:00.883646 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:00.884085 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lazy-loading 'fault' on Instance uuid ee6e2576-b7f0-40bf-adec-2fcb59ed5467 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:00.923552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:00.932104 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8296e54c-ae95-4442-a63a-96526f8fa056 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 200 len: 1231 microversion: 2.1 time: 0.092473 Aug 31 10:00:00.932668 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 582/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:00 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 1231 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:00:01.954138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:01.954829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: ee6e2576-b7f0-40bf-adec-2fcb59ed5467] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:01.961637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:01.962112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:01.962542 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:01.963219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:01.963671 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:01.964085 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:01.977383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] HTTP exception thrown: Instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 could not be found. Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Request method failure captured: Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 HTTP/1.1 Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy6mVIvQVcLkVy7cMy-Xpfme2Ur2Xo5Iop84FneswGvRPKJgvVEv-d2i2jdWurhLb4GzgY7L70J_aHG_BY7RgqDCtMWfW__OGEd8SY1ItEq6Yo_q31iJyXuQZUfwXSH6kcOpuKlPtwlBMAevOJZrXX_GKX7rI0WXBkb9VUDazgn_mVI Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 10:00:01.979189 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6e3fe84eb42b4a1a70e76b5de9fa2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 5669f5e5dcd74e01b4fb7c1bd512bd82 Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 could not be found. Aug 31 10:00:01.980668 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': 'ee6e2576-b7f0-40bf-adec-2fcb59ed5467'} Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 could not be found. Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:01.981615 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 could not be found. Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 could not be found. Aug 31 10:00:01.983285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:01.985105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Returning 404 to user: Instance ee6e2576-b7f0-40bf-adec-2fcb59ed5467 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:01.985105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7db112e5-34be-4f42-a044-07c30baf317c tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467" status: 404 len: 111 microversion: 2.1 time: 0.031176 Aug 31 10:00:01.985105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 590/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:01 2022] GET /compute/v2.1/servers/ee6e2576-b7f0-40bf-adec-2fcb59ed5467 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:06.070661 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:06.071191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:06.073238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-27a08c4f-3ef5-4b82-ada5-d635e45da346 req-f05ac013-afbf-4244-a634-d3721591e104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680c3846-0a17-40b6-8be9-8e81e957b047", "tag": "5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:06.077589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.078091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.078534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:06.079241 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.079701 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.080131 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:06.083927 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-27a08c4f-3ef5-4b82-ada5-d635e45da346 req-f05ac013-afbf-4244-a634-d3721591e104 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.084775 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-27a08c4f-3ef5-4b82-ada5-d635e45da346 req-f05ac013-afbf-4244-a634-d3721591e104 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.086034 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-27a08c4f-3ef5-4b82-ada5-d635e45da346 req-f05ac013-afbf-4244-a634-d3721591e104 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:06.098917 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-27a08c4f-3ef5-4b82-ada5-d635e45da346 req-f05ac013-afbf-4244-a634-d3721591e104 service nova] Creating event network-changed:5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3 for instance 680c3846-0a17-40b6-8be9-8e81e957b047 on hv-cinder-83754 Aug 31 10:00:06.104903 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-27a08c4f-3ef5-4b82-ada5-d635e45da346 req-f05ac013-afbf-4244-a634-d3721591e104 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Aug 31 10:00:06.105875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 591/1173] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:06.108496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:00:06.188583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6d2ac8f5-9499-4fe0-86e3-6b862e6bf063 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 204 len: 0 microversion: 2.1 time: 0.121455 Aug 31 10:00:06.189735 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 583/1174] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 10:00:06 2022] DELETE /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:00:06.199751 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:06.200695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:06.208209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.208702 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.209221 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:06.211649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.211649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.211649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:06.347424 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:06.355451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-bf0787a6-ac57-479e-9f39-b3125fbb34e1 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1575 microversion: 2.1 time: 0.160949 Aug 31 10:00:06.356033 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 592/1175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:06 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:07.376486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:07.377136 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:07.383750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:07.384235 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:07.384672 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:07.385396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:07.385872 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:07.386296 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:07.527947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:07.535636 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e64ece15-8b74-4432-8dc0-ee067cf2657a tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1456 microversion: 2.1 time: 0.163442 Aug 31 10:00:07.536207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 584/1176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:07 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1456 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:08.150980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-d7d5ba8e-bcf2-49a1-bd6f-c6859b67c312 req-831f00b3-453a-4046-be11-7efbc7fbf277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680c3846-0a17-40b6-8be9-8e81e957b047", "name": "network-vif-deleted", "tag": "5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:08.162596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d7d5ba8e-bcf2-49a1-bd6f-c6859b67c312 req-831f00b3-453a-4046-be11-7efbc7fbf277 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.163097 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d7d5ba8e-bcf2-49a1-bd6f-c6859b67c312 req-831f00b3-453a-4046-be11-7efbc7fbf277 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.163640 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-d7d5ba8e-bcf2-49a1-bd6f-c6859b67c312 req-831f00b3-453a-4046-be11-7efbc7fbf277 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.175637 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-d7d5ba8e-bcf2-49a1-bd6f-c6859b67c312 req-831f00b3-453a-4046-be11-7efbc7fbf277 service nova] Creating event network-vif-deleted:5e0b1d7c-2176-47b1-91a6-ff8a74dfbfc3 for instance 680c3846-0a17-40b6-8be9-8e81e957b047 on hv-cinder-83754 Aug 31 10:00:08.181264 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-d7d5ba8e-bcf2-49a1-bd6f-c6859b67c312 req-831f00b3-453a-4046-be11-7efbc7fbf277 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035851 Aug 31 10:00:08.181864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 593/1177] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:08.557049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:08.557714 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:08.567041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.567543 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.567985 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.568768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.569222 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.575411 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.604556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e21873fe-94fb-45ea-97ac-39b81ec4d9db", "device": "/dev/sdb"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:08.607703 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:08.608215 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.608706 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.609303 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.609690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lazy-loading 'fault' on Instance uuid 680c3846-0a17-40b6-8be9-8e81e957b047 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:08.617156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.617691 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.619200 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.620548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.621552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.621995 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.651947 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5669f5e5dcd74e01b4fb7c1bd512bd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6e3fe84eb42b4a1a70e76b5de9fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:08.659880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-74ec8b22-f02a-4eb6-84ba-7267889fe752 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 200 len: 1230 microversion: 2.1 time: 0.106676 Aug 31 10:00:08.660723 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 585/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:08 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:08.902664 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-7e461068-3e95-4f16-9f01-4844df98f15a tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "POST /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303177 Aug 31 10:00:08.904262 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 594/1179] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 10:00:08 2022] POST /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:00:09.683040 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:09.683647 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 680c3846-0a17-40b6-8be9-8e81e957b047] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:09.689982 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:09.690461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:09.690893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:09.691578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:09.692029 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:09.692451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:09.705778 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] HTTP exception thrown: Instance 680c3846-0a17-40b6-8be9-8e81e957b047 could not be found. Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Request method failure captured: Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 HTTP/1.1 Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy6mVIvQVcLkVy7cMy-Xpfme2Ur2Xo5Iop84FneswGvRPKJgvVEv-d2i2jdWurhLb4GzgY7L70J_aHG_BY7RgqDCtMWfW__OGEd8SY1ItEq6Yo_q31iJyXuQZUfwXSH6kcOpuKlPtwlBMAevOJZrXX_GKX7rI0WXBkb9VUDazgn_mVI Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 10:00:09.707754 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6e3fe84eb42b4a1a70e76b5de9fa2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 5669f5e5dcd74e01b4fb7c1bd512bd82 Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 680c3846-0a17-40b6-8be9-8e81e957b047 could not be found. Aug 31 10:00:09.710907 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '680c3846-0a17-40b6-8be9-8e81e957b047'} Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680c3846-0a17-40b6-8be9-8e81e957b047 could not be found. Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:09.712524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680c3846-0a17-40b6-8be9-8e81e957b047 could not be found. Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680c3846-0a17-40b6-8be9-8e81e957b047 could not be found. Aug 31 10:00:09.714144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:09.716195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Returning 404 to user: Instance 680c3846-0a17-40b6-8be9-8e81e957b047 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:09.716195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-081ac3db-6da1-4709-b4c7-f6125df56019 tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047" status: 404 len: 111 microversion: 2.1 time: 0.030328 Aug 31 10:00:09.716195 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 586/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:09 2022] GET /compute/v2.1/servers/680c3846-0a17-40b6-8be9-8e81e957b047 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:10.154721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:10.155302 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:10.161422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:10.161904 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:10.162332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:10.163532 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:10.163996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:10.164410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:10.177980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] HTTP exception thrown: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Request method failure captured: Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a HTTP/1.1 Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDy6mVIvQVcLkVy7cMy-Xpfme2Ur2Xo5Iop84FneswGvRPKJgvVEv-d2i2jdWurhLb4GzgY7L70J_aHG_BY7RgqDCtMWfW__OGEd8SY1ItEq6Yo_q31iJyXuQZUfwXSH6kcOpuKlPtwlBMAevOJZrXX_GKX7rI0WXBkb9VUDazgn_mVI Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 10:00:10.180507 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6e3fe84eb42b4a1a70e76b5de9fa2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 5669f5e5dcd74e01b4fb7c1bd512bd82 Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.182227 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '68a576c4-6c87-49fd-b00b-ea140c968c8a'} Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:10.183167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.184722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.186244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Returning 404 to user: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:10.186244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a138756d-ee2b-4173-aa44-f7afb639dbbc tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 404 len: 111 microversion: 2.1 time: 0.031932 Aug 31 10:00:10.186244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 595/1181] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 10:00:10 2022] DELETE /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:10.191045 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:10.191763 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] [instance: 68a576c4-6c87-49fd-b00b-ea140c968c8a] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:10.197698 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:10.198181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:10.198622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:10.199310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:10.199769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:10.200203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:10.215814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] HTTP exception thrown: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Request method failure captured: Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a HTTP/1.1 Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDy6mVIvQVcLkVy7cMy-Xpfme2Ur2Xo5Iop84FneswGvRPKJgvVEv-d2i2jdWurhLb4GzgY7L70J_aHG_BY7RgqDCtMWfW__OGEd8SY1ItEq6Yo_q31iJyXuQZUfwXSH6kcOpuKlPtwlBMAevOJZrXX_GKX7rI0WXBkb9VUDazgn_mVI Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 10:00:10.217377 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6e3fe84eb42b4a1a70e76b5de9fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6e3fe84eb42b4a1a70e76b5de9fa2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 9df6e3fe84eb42b4a1a70e76b5de9fa2 Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-TestVolumeBootPattern-671425473 Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 5669f5e5dcd74e01b4fb7c1bd512bd82 Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-TestVolumeBootPattern-671425473-project Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.219032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '68a576c4-6c87-49fd-b00b-ea140c968c8a'} Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:10.220132 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. Aug 31 10:00:10.221659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:00:10.223086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Returning 404 to user: Instance 68a576c4-6c87-49fd-b00b-ea140c968c8a could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:10.223086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-6a76b38a-64fd-4215-894d-3808ab156cbd tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a" status: 404 len: 111 microversion: 2.1 time: 0.031517 Aug 31 10:00:10.223086 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 587/1182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:10 2022] GET /compute/v2.1/servers/68a576c4-6c87-49fd-b00b-ea140c968c8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:11.505263 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3d7d3d98-1e60-4c46-b274-0d00e7ba31be tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] Calling method '.version_select at 0x7f0b528fe550>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:11.527441 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3d7d3d98-1e60-4c46-b274-0d00e7ba31be tempest-TestVolumeBootPattern-671425473 tempest-TestVolumeBootPattern-671425473-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2048261769" status: 202 len: 0 microversion: 2.1 time: 0.025985 Aug 31 10:00:11.528030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 596/1183] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Aug 31 10:00:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2048261769 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:00:36.934191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:36.934691 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:36.937259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:36.938044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:36.944286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.944702 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.945169 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.946468 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.946924 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.947351 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.028624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lazy-loading 'services' on Instance uuid 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:37.099460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4af9585e-1c5f-4fac-9a1f-e1c6f11dfec8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514/os-volume_attachments/e21873fe-94fb-45ea-97ac-39b81ec4d9db" status: 202 len: 0 microversion: 2.1 time: 0.169454 Aug 31 10:00:37.100058 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 588/1184] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 10:00:36 2022] DELETE /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514/os-volume_attachments/e21873fe-94fb-45ea-97ac-39b81ec4d9db => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:00:38.219443 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:38.220219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:38.224524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:38.225048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:38.236550 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.237172 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.237618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.238323 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.238782 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.239220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.268181 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Going to try to terminate instance {{(pid=132479) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:00:38.342639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-36a04e17-97f5-4e31-a041-1fe5e3772a83 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 204 len: 0 microversion: 2.1 time: 0.124831 Aug 31 10:00:38.343364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 597/1185] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 10:00:38 2022] DELETE /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:00:38.353110 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:38.353813 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:38.359834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.360317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.360757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.361472 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.361928 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.362350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.495439 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:38.503049 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a9d65858-60f9-4d83-8e28-1822e398b972 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1512 microversion: 2.1 time: 0.154709 Aug 31 10:00:38.503614 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 589/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:38 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:39.526025 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:39.526721 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:39.533136 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:39.533619 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:39.534052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:39.534737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:39.535187 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:39.535610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:39.664093 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:39.671876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c4e0e4f1-1a91-41ee-89f5-44f44203b19d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1512 microversion: 2.1 time: 0.150957 Aug 31 10:00:39.672444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 598/1187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:39 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:40.693590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:40.694143 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:40.701096 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:40.701587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:40.702022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.702714 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:40.703174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:40.703635 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.829062 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:40.836781 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b6d331fd-101d-4f79-9432-00265d05c997 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1512 microversion: 2.1 time: 0.147136 Aug 31 10:00:40.837386 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 590/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:40 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:41.315543 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-e157c956-72ac-4a30-b23c-5e224a56c267 req-3f7c2ca1-6157-4816-9c9f-332bd193ff2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8cc53d-ab70-47b4-be45-d9e0cbb79514", "name": "network-vif-deleted", "tag": "f10055e3-7f1b-4085-9785-77d1f109b496"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:41.328174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e157c956-72ac-4a30-b23c-5e224a56c267 req-3f7c2ca1-6157-4816-9c9f-332bd193ff2e service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.328748 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e157c956-72ac-4a30-b23c-5e224a56c267 req-3f7c2ca1-6157-4816-9c9f-332bd193ff2e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.329219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-e157c956-72ac-4a30-b23c-5e224a56c267 req-3f7c2ca1-6157-4816-9c9f-332bd193ff2e service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.343427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-e157c956-72ac-4a30-b23c-5e224a56c267 req-3f7c2ca1-6157-4816-9c9f-332bd193ff2e service nova] Creating event network-vif-deleted:f10055e3-7f1b-4085-9785-77d1f109b496 for instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 on hv-cinder-83754 Aug 31 10:00:41.349167 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-e157c956-72ac-4a30-b23c-5e224a56c267 req-3f7c2ca1-6157-4816-9c9f-332bd193ff2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Aug 31 10:00:41.350147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 599/1189] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:41.858354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:41.858932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:41.865349 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.865839 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.866284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.867609 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.868066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.868563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.899930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.900417 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.900856 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.901773 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lazy-loading 'fault' on Instance uuid 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:41.942643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:41.951295 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b6a7af36-fc51-445e-a1b1-b821a9c32fde tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 200 len: 1308 microversion: 2.1 time: 0.096886 Aug 31 10:00:41.951875 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 591/1190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:41 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:42.974010 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:42.974711 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 9e8cc53d-ab70-47b4-be45-d9e0cbb79514] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:42.981329 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.981814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.982248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.982932 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.983383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.983864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.997410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] HTTP exception thrown: Instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 could not be found. Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Request method failure captured: Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 HTTP/1.1 Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDzDshOuG2xdyf9jfbGEWZdSF1ZoBRg-hB8lePfxCRIKPT0kdPiHFiFldIipMgWpTRAcbqnxY2MfiIdKwzIv_zDqhewcqGMIX9DVwsEjCVpSUmhgRcyqJadkgKg9LNs8WwR7R8x9czyXk4K5qY5pbmZjz_vFotVVDOTV4iy6PHDyYVwA Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 652969f53c4746f0ac3e06c2bf0783cf Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1238504819 Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 10:00:42.998998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/652969f53c4746f0ac3e06c2bf0783cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/652969f53c4746f0ac3e06c2bf0783cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/652969f53c4746f0ac3e06c2bf0783cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_652969f53c4746f0ac3e06c2bf0783cf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-VolumesSnapshotTestJSON-1238504819 Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 652969f53c4746f0ac3e06c2bf0783cf Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1238504819 Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-VolumesSnapshotTestJSON-1238504819-project Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: dd065f00c6554be59c75671de39bd1b7 Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-VolumesSnapshotTestJSON-1238504819-project Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 could not be found. Aug 31 10:00:43.000761 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '9e8cc53d-ab70-47b4-be45-d9e0cbb79514'} Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 could not be found. Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:43.002046 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 could not be found. Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 could not be found. Aug 31 10:00:43.003881 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:00:43.005470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Returning 404 to user: Instance 9e8cc53d-ab70-47b4-be45-d9e0cbb79514 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:43.005470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ce7112c2-1be9-494d-91a5-b8bcaf9852de tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514" status: 404 len: 111 microversion: 2.1 time: 0.030629 Aug 31 10:00:43.005470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 600/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:42 2022] GET /compute/v2.1/servers/9e8cc53d-ab70-47b4-be45-d9e0cbb79514 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:54.944976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1023148807", "imageRef": "0df306e3-2ded-49f3-bcf8-5c04649258d9", "flavorRef": "452", "networks": [{"uuid": "b284f934-c11c-4c4d-937f-56eda9e00de3"}]}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:54.954041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=10 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:54.954688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:55.000618 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.network.neutron [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] validate_networks() for [('b284f934-c11c-4c4d-937f-56eda9e00de3', None, None, None, None, None)] {{(pid=132478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:00:55.339716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Flavor limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:00:55.340196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Image limits 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:00:55.340610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Flavor pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:00:55.341044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Image pref 0:0:0 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:00:55.341458 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.virt.hardware [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:00:55.350120 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:55.351091 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:55.351521 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:55.352246 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:55.352699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:55.353149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:55.370292 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Getting quotas for project 652969f53c4746f0ac3e06c2bf0783cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:00:55.374183 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Getting quotas for user dd065f00c6554be59c75671de39bd1b7 and project 652969f53c4746f0ac3e06c2bf0783cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:00:55.384905 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Going to run 1 instances... {{(pid=132478) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:00:55.387171 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0df306e3-2ded-49f3-bcf8-5c04649258d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:00:55.432319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-537968ad-a905-424a-af67-243c4cd7e69c tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491186 Aug 31 10:00:55.432973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 592/1192] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 10:00:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:00:55.443642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0b168892-f687-46ff-9139-25efecd21f11 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:55.444291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0b168892-f687-46ff-9139-25efecd21f11 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:55.446437 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:55.447083 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:55.505525 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0b168892-f687-46ff-9139-25efecd21f11 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:55.512716 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0b168892-f687-46ff-9139-25efecd21f11 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1219 microversion: 2.1 time: 0.073027 Aug 31 10:00:55.513318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 601/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:55 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:56.533931 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:56.534544 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:56.541506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:56.541932 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:56.542368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:56.543079 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:56.543536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:56.543968 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:56.613930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:56.622488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c237e3c8-7aba-46a0-818a-c2821796bd5b tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1279 microversion: 2.1 time: 0.092761 Aug 31 10:00:56.636231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 593/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:56 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:57.643279 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:57.644059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:57.651147 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:57.651634 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:57.652070 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:57.652767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:57.653246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:57.653672 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:57.787002 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:57.794770 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5b777567-d2cc-4468-8d19-9cc6f46d0699 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.155395 Aug 31 10:00:57.795446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 602/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:57 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:57.839057 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-a0549287-e628-49ed-afbb-45edd51929f4 req-016a9f71-9606-4da1-89b7-c77a9224d025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e7046f-0231-451b-b39b-c19d38f86707", "tag": "6cda2a9f-59f1-45db-888e-4330a2becccb"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:57.850553 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a0549287-e628-49ed-afbb-45edd51929f4 req-016a9f71-9606-4da1-89b7-c77a9224d025 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:57.851181 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a0549287-e628-49ed-afbb-45edd51929f4 req-016a9f71-9606-4da1-89b7-c77a9224d025 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:57.851720 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a0549287-e628-49ed-afbb-45edd51929f4 req-016a9f71-9606-4da1-89b7-c77a9224d025 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:57.865663 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-a0549287-e628-49ed-afbb-45edd51929f4 req-016a9f71-9606-4da1-89b7-c77a9224d025 service nova] Creating event network-changed:6cda2a9f-59f1-45db-888e-4330a2becccb for instance 84e7046f-0231-451b-b39b-c19d38f86707 on hv-cinder-83754 Aug 31 10:00:57.870938 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-a0549287-e628-49ed-afbb-45edd51929f4 req-016a9f71-9606-4da1-89b7-c77a9224d025 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035624 Aug 31 10:00:57.871536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 594/1196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:00:58.815695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:58.816383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:58.823381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:58.823869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:58.824307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:58.825024 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:58.825483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:58.825912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:58.951680 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:58.959296 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5fb785b0-5346-41f5-8a8b-f3532b4fa3d1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.147543 Aug 31 10:00:58.959878 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 603/1197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:58 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:59.980061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:59.980760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:59.987369 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:59.987850 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:59.988306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:59.989017 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:59.989473 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:59.989895 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:00.120144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:00.127795 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-61054e9f-d722-4463-a092-4e830e1a9797 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.151875 Aug 31 10:01:00.128368 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 595/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:59 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:01.148563 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:01.149216 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:01.155639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:01.156123 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:01.156556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:01.157278 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:01.157735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:01.158158 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:01.301446 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:01.309885 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8e44a78d-10f9-4451-bf6d-84431f671c00 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.165133 Aug 31 10:01:01.310480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 604/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:01 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:02.330807 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:02.331406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:02.337876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:02.338354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:02.338782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:02.339461 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:02.339960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:02.340329 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:02.467513 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:02.475629 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-f73e954f-8a04-4666-8560-66f9be5bf38d tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.148093 Aug 31 10:01:02.476189 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 596/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:02 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:03.496182 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:03.496792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:03.503255 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:03.503737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:03.504174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:03.504861 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:03.505351 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:03.505776 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:03.634987 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:03.642650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0ded6f85-97e1-4f56-8558-e60c7b19554e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.150360 Aug 31 10:01:03.643213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 605/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:03 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:03.842921 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-a154e6e1-6ea8-4429-9a3b-0172cde9f984 req-1f93b23a-9c69-4b72-b1e3-98aa18010ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e7046f-0231-451b-b39b-c19d38f86707", "name": "network-vif-plugged", "status": "completed", "tag": "6cda2a9f-59f1-45db-888e-4330a2becccb"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:03.853916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a154e6e1-6ea8-4429-9a3b-0172cde9f984 req-1f93b23a-9c69-4b72-b1e3-98aa18010ffe service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:03.854406 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a154e6e1-6ea8-4429-9a3b-0172cde9f984 req-1f93b23a-9c69-4b72-b1e3-98aa18010ffe service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:03.854834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a154e6e1-6ea8-4429-9a3b-0172cde9f984 req-1f93b23a-9c69-4b72-b1e3-98aa18010ffe service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:03.866741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-a154e6e1-6ea8-4429-9a3b-0172cde9f984 req-1f93b23a-9c69-4b72-b1e3-98aa18010ffe service nova] Creating event network-vif-plugged:6cda2a9f-59f1-45db-888e-4330a2becccb for instance 84e7046f-0231-451b-b39b-c19d38f86707 on hv-cinder-83754 Aug 31 10:01:03.871965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-a154e6e1-6ea8-4429-9a3b-0172cde9f984 req-1f93b23a-9c69-4b72-b1e3-98aa18010ffe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Aug 31 10:01:03.872852 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 597/1202] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:04.663536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:04.664152 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:04.670565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:04.671040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:04.671469 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:04.672146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:04.672595 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:04.673037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:04.799914 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:04.807961 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4de912d6-359f-4359-8284-dedb88a060b1 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.148245 Aug 31 10:01:04.808528 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 606/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:04 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:05.830348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:05.831006 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:05.833425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:05.834108 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=6 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:05.841107 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:05.841589 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:05.842020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:05.842727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:05.843177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:05.843596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:05.977244 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:05.984659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b6c01a33-6e60-4d3e-b5d7-d31d51feee74 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1319 microversion: 2.1 time: 0.158689 Aug 31 10:01:05.985248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 598/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:05 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:07.005953 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:07.007112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:07.008943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:07.014800 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:07.015286 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:07.015723 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:07.016422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:07.016880 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:07.017332 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:07.146472 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:07.154154 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-86398a28-56b2-4a2f-9bef-e67634d1ce38 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1508 microversion: 2.1 time: 0.152229 Aug 31 10:01:07.154722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 607/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:07 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:07.175061 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158a60fd-6e1b-4676-bf74-02975c208fb1", "device": "/dev/sdb"}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:07.178573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:07.184948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:07.185452 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:07.185884 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:07.186690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:07.187146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:07.187567 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:07.446254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c372587f-66f9-494a-9ca1-f260a0df59dd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "POST /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275218 Aug 31 10:01:07.446857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 599/1206] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 31 10:01:07 2022] POST /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:29.859062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:29.859594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:29.861541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=16 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:29.862251 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=36 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:29.867724 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:29.868206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:29.868635 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:29.869379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:29.869839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:29.870260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:30.101698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lazy-loading 'services' on Instance uuid 84e7046f-0231-451b-b39b-c19d38f86707 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:01:30.171996 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2c06ec75-6426-44c9-98d7-f9eac015dbbd tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707/os-volume_attachments/158a60fd-6e1b-4676-bf74-02975c208fb1" status: 202 len: 0 microversion: 2.1 time: 0.316782 Aug 31 10:01:30.172608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 608/1207] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 10:01:29 2022] DELETE /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707/os-volume_attachments/158a60fd-6e1b-4676-bf74-02975c208fb1 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:01:32.341953 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:32.342656 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:32.346630 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:32.347210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:32.354570 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:32.355122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:32.355562 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:32.356252 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:32.356708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:32.357160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:32.383906 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:01:32.458010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-846dadaf-8e3b-4aaf-b270-9298a5044e3e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 204 len: 0 microversion: 2.1 time: 0.117394 Aug 31 10:01:32.458578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 600/1208] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 10:01:32 2022] DELETE /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:01:32.467743 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:32.468434 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:32.474736 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:32.475214 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:32.475649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:32.476331 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:32.476777 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:32.477246 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:32.609658 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:32.617907 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-edc04441-5ac4-4c9b-b87b-6aad8a9b0251 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1514 microversion: 2.1 time: 0.154972 Aug 31 10:01:32.618493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 609/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:32 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:33.639289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:33.639991 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:33.646253 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:33.646740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:33.647176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:33.647868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:33.648348 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:33.648779 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:33.877063 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:33.884693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-dc10b011-884f-456f-8273-c9cc677f1fbf tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1514 microversion: 2.1 time: 0.249689 Aug 31 10:01:33.885304 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 601/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:33 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:34.906037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:34.906651 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:34.913090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:34.913578 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:34.914013 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:34.914700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:34.915153 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:34.915579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:35.045175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:35.053130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a4590074-38a4-4a33-b49a-d8a09cfc16b9 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1514 microversion: 2.1 time: 0.150954 Aug 31 10:01:35.053693 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 610/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:34 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:35.632951 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-e2ba1b01-45f2-4e85-a876-3bc76a9df554 req-c831792e-b102-4f75-bba4-956e1d6c0ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e7046f-0231-451b-b39b-c19d38f86707", "name": "network-vif-deleted", "tag": "6cda2a9f-59f1-45db-888e-4330a2becccb"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:35.648395 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e2ba1b01-45f2-4e85-a876-3bc76a9df554 req-c831792e-b102-4f75-bba4-956e1d6c0ff5 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:35.648877 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e2ba1b01-45f2-4e85-a876-3bc76a9df554 req-c831792e-b102-4f75-bba4-956e1d6c0ff5 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:35.649341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-e2ba1b01-45f2-4e85-a876-3bc76a9df554 req-c831792e-b102-4f75-bba4-956e1d6c0ff5 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:35.660062 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-e2ba1b01-45f2-4e85-a876-3bc76a9df554 req-c831792e-b102-4f75-bba4-956e1d6c0ff5 service nova] Creating event network-vif-deleted:6cda2a9f-59f1-45db-888e-4330a2becccb for instance 84e7046f-0231-451b-b39b-c19d38f86707 on hv-cinder-83754 Aug 31 10:01:35.665625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-e2ba1b01-45f2-4e85-a876-3bc76a9df554 req-c831792e-b102-4f75-bba4-956e1d6c0ff5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037006 Aug 31 10:01:35.666204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 602/1212] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:36.074556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:36.075164 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:36.081623 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:36.082130 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:36.082561 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:36.083249 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:36.084213 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:36.084631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:36.117945 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:36.118356 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:36.118798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:36.119248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lazy-loading 'fault' on Instance uuid 84e7046f-0231-451b-b39b-c19d38f86707 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:01:36.158500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd065f00c6554be59c75671de39bd1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652969f53c4746f0ac3e06c2bf0783cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:36.167016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6dc35f51-a884-45d6-996b-780500ed7fa8 tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 200 len: 1309 microversion: 2.1 time: 0.096296 Aug 31 10:01:36.167593 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 611/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:36 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:37.188256 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:37.188979 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] [instance: 84e7046f-0231-451b-b39b-c19d38f86707] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:37.195910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:37.196396 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:37.196836 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:37.197559 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:37.198018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:37.198451 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:37.211431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] HTTP exception thrown: Instance 84e7046f-0231-451b-b39b-c19d38f86707 could not be found. Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Request method failure captured: Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 HTTP/1.1 Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDzDshOuG2xdyf9jfbGEWZdSF1ZoBRg-hB8lePfxCRIKPT0kdPiHFiFldIipMgWpTRAcbqnxY2MfiIdKwzIv_zDqhewcqGMIX9DVwsEjCVpSUmhgRcyqJadkgKg9LNs8WwR7R8x9czyXk4K5qY5pbmZjz_vFotVVDOTV4iy6PHDyYVwA Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: 652969f53c4746f0ac3e06c2bf0783cf Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1238504819 Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 10:01:37.213129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/652969f53c4746f0ac3e06c2bf0783cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/652969f53c4746f0ac3e06c2bf0783cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/652969f53c4746f0ac3e06c2bf0783cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_652969f53c4746f0ac3e06c2bf0783cf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-VolumesSnapshotTestJSON-1238504819 Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: 652969f53c4746f0ac3e06c2bf0783cf Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1238504819 Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-VolumesSnapshotTestJSON-1238504819-project Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: dd065f00c6554be59c75671de39bd1b7 Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-VolumesSnapshotTestJSON-1238504819-project Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 84e7046f-0231-451b-b39b-c19d38f86707 could not be found. Aug 31 10:01:37.214743 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '84e7046f-0231-451b-b39b-c19d38f86707'} Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e7046f-0231-451b-b39b-c19d38f86707 could not be found. Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:01:37.215634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e7046f-0231-451b-b39b-c19d38f86707 could not be found. Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e7046f-0231-451b-b39b-c19d38f86707 could not be found. Aug 31 10:01:37.217399 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:01:37.218960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] Returning 404 to user: Instance 84e7046f-0231-451b-b39b-c19d38f86707 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:01:37.218960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-2b1c6575-aafc-4a58-b266-7c4ecf523e2e tempest-VolumesSnapshotTestJSON-1238504819 tempest-VolumesSnapshotTestJSON-1238504819-project] 10.222.0.25 "GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707" status: 404 len: 111 microversion: 2.1 time: 0.030597 Aug 31 10:01:37.218960 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 603/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:37 2022] GET /compute/v2.1/servers/84e7046f-0231-451b-b39b-c19d38f86707 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:01:45.015382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:45.017756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:45.024353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:45.024839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:45.025328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:45.026024 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:45.026482 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:45.026910 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:45.097520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d2089ba7-fd8d-42be-abd1-4c5e59722ddd tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/action" status: 202 len: 0 microversion: 2.1 time: 0.085793 Aug 31 10:01:45.098194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 612/1215] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 10:01:45 2022] POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 10:01:45.106467 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:45.107080 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:45.114041 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:45.114522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:45.114955 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:45.115644 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:45.116092 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:45.116506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:45.317228 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:45.326117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-be07a78a-a5c6-4ebb-bbf2-f53d585f3771 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1750 microversion: 2.1 time: 0.223592 Aug 31 10:01:45.327242 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 604/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:45 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1750 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:46.348731 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:46.349454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:46.355768 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:46.356253 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:46.356684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:46.357412 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:46.357869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:46.358316 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:46.504933 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:46.513728 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-bee4e9d3-a9e6-435e-be9c-0470ebbaadd2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.169799 Aug 31 10:01:46.514391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 613/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:46 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:47.535690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:47.536374 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:47.543159 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:47.543634 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:47.544064 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:47.544742 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:47.545218 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:47.545676 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:47.686531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:47.694816 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-99b9aaa3-30f2-41d6-9170-9afc3516ace7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.163017 Aug 31 10:01:47.695383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 605/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:47 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:48.716201 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:48.716815 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:48.722864 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:48.723355 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:48.723791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:48.724483 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:48.724939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:48.725396 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:49.129050 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:49.137488 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-6274f8bc-3834-4df6-8269-bc3bf41c19e0 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.425377 Aug 31 10:01:49.138065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 614/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:48 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:50.158659 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:50.159273 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:50.165707 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:50.166751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:50.167198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:50.167881 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:50.168335 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:50.168762 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:50.305695 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:50.313950 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-3b7f4ef9-cdfe-421c-a637-c149aef05a80 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.159187 Aug 31 10:01:50.314530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 606/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:50 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:51.335049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:51.335589 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:51.342030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:51.342517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:51.342956 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:51.343650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:51.344109 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:51.344536 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:51.485946 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:51.495292 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-f70cd1ae-0bd6-4dbe-aaac-c388c1d05423 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.164354 Aug 31 10:01:51.495893 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 615/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:51 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:52.516863 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:52.517435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:52.523803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:52.524289 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:52.524725 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:52.525460 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:52.525916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:52.526341 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:52.669196 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:52.677587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-fb52a987-7e7c-4a28-b613-5019a4cbcfa8 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.164664 Aug 31 10:01:52.678160 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 607/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:52 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:53.699222 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:53.699843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:53.706196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:53.706683 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:53.707118 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:53.707808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:53.708404 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:53.708720 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:53.850047 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:53.859031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b03d09e9-0c6d-4248-85f1-6f03c9f11923 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.163530 Aug 31 10:01:53.859598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 616/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:53 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:54.879673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:54.880286 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:54.886624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:54.887106 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:54.887542 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:54.888272 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:54.888731 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:54.889187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:55.033141 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:55.041362 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b03f6876-a2ce-4eac-b430-4e4b6d93000c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.165554 Aug 31 10:01:55.041930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 608/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:54 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:56.062453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:56.063062 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:56.069617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:56.070102 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:56.070533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:56.071218 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:56.071674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:56.072094 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:56.210756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:56.219381 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e57da09e-18ef-4f88-a073-5b02534df1a7 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.160796 Aug 31 10:01:56.219954 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 617/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:56 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:57.241516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:57.242123 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:57.249126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:57.249686 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:57.250121 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:57.250814 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:57.251302 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:57.251727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:57.392786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:57.400996 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-29b84b41-c5f8-4cd2-b6d8-576d81ff5f79 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.163373 Aug 31 10:01:57.401670 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 609/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:57 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:58.422065 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:58.422622 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:58.429358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:58.429883 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:58.430325 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:58.431020 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:58.431481 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:58.431911 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:58.577804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:58.587458 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-5054cb86-4c1a-4a3a-bf20-237cdba16741 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.169312 Aug 31 10:01:58.588039 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 618/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:58 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:59.608860 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:59.609440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:59.616038 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:59.616525 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:59.616976 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:59.617675 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:59.618128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:59.618554 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:59.759684 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:59.768354 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8fcaf514-b3cd-4a2a-8556-267855ebaf68 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.163523 Aug 31 10:01:59.768928 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 610/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:59 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:00.788828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:00.789480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:00.791959 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=25 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:00.797845 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:00.798581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:00.799009 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:00.799690 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:00.800138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:00.800554 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:00.803094 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:00.944986 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:00.953756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-2c10ecf9-0b9c-4b44-ab3c-3f90c1445791 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.168797 Aug 31 10:02:00.954314 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 619/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:00 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:01.975305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:01.975914 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:01.982426 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:01.982911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:01.983343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:01.984029 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:01.984481 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:01.984903 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:02.129425 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:02.137479 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-a6ea4bc7-1abb-4e82-8021-5d72801021c9 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1755 microversion: 2.1 time: 0.166080 Aug 31 10:02:02.138100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 611/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:01 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:03.158793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:03.159409 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:03.166133 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:03.166625 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:03.167057 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:03.168334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:03.168984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:03.169581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:03.324470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:03.334524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-c482bdee-db32-4033-8280-412c4507d06e tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1758 microversion: 2.1 time: 0.179138 Aug 31 10:02:03.335328 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 620/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:03 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:12.983673 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:12.984584 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:13.176336 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-82fa4bb3-a731-43e9-b11b-b9b8de1cc8e7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Action: 'create', calling method: .version_select at 0x7f0b52a6e790>, body: {"keypair": {"name": "tempest-TestShelveInstance-102092292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XibZuO7j4herdVxVsQe5PSIfYVvBBv4azMLWqr1sqhS4afIIVw88OaQWRTkXmayEzSpzRFYsNCtaDMkMbuytc7217rXjhfBbBAmN5m7e4BxJ3UkHo8J8HOl82xTr9xg=="}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:13.192191 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-82fa4bb3-a731-43e9-b11b-b9b8de1cc8e7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Getting quotas for project 52d82faa2ab445e18d6e3d668821c1e5. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:02:13.196112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.quota [None req-82fa4bb3-a731-43e9-b11b-b9b8de1cc8e7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Getting quotas for user e170e5057c6f4467b247b2175d2b3ba5 and project 52d82faa2ab445e18d6e3d668821c1e5. Resources: {'key_pairs'} {{(pid=132478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:02:13.221642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-82fa4bb3-a731-43e9-b11b-b9b8de1cc8e7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.242487 Aug 31 10:02:13.228073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 612/1232] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 31 10:02:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:02:37.810765 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-310930411", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-102092292", "security_groups": [{"name": "tempest-secgroup-smoke-762651482"}], "networks": [{"uuid": "baab726d-19ab-48c5-8ec7-e361996d611e"}], "block_device_mapping_v2": [{"uuid": "9aaf2edd-ce64-4b31-a614-7ae8662c9c02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:37.820804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:37.821493 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=11 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:37.822628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:02:37.822809 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Wed Aug 31 10:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 31 10:02:37.823786 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:02:37.823924 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Wed Aug 31 10:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 31 10:02:37.934912 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.network.neutron [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] validate_networks() for [('baab726d-19ab-48c5-8ec7-e361996d611e', None, None, None, None, None)] {{(pid=132479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:02:38.296369 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Flavor limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:02:38.296796 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Image limits 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:02:38.297565 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Flavor pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:02:38.297976 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Image pref 0:0:0 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:02:38.298385 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.virt.hardware [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:02:38.307170 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:38.307649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:38.308081 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:38.308802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:38.309295 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:38.309739 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:38.326105 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Getting quotas for project 52d82faa2ab445e18d6e3d668821c1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:02:38.330064 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.quota [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Getting quotas for user e170e5057c6f4467b247b2175d2b3ba5 and project 52d82faa2ab445e18d6e3d668821c1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=132479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:02:38.386117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Going to run 1 instances... {{(pid=132479) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:02:38.388254 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9aaf2edd-ce64-4b31-a614-7ae8662c9c02',volume_size=None,volume_type=None)] {{(pid=132479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:02:38.517596 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-0feb3676-4c73-47f0-bc14-086ba1b44650 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711310 Aug 31 10:02:38.518244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 621/1233] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 31 10:02:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:02:38.526890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=4 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:38.527703 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:38.531834 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-75a83aa0-33bc-4392-8aee-8d3255ae5e21 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:38.532474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-75a83aa0-33bc-4392-8aee-8d3255ae5e21 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:38.588116 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-75a83aa0-33bc-4392-8aee-8d3255ae5e21 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:38.595281 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-75a83aa0-33bc-4392-8aee-8d3255ae5e21 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1087 microversion: 2.1 time: 0.070165 Aug 31 10:02:38.596075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 613/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:38 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:39.617031 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:39.617645 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:39.624644 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:39.625179 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:39.625643 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:39.626418 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:39.626877 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:39.627300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:39.692725 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:39.701429 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9c4340bf-034d-45f7-aae7-503b8953fb76 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1193 microversion: 2.1 time: 0.089091 Aug 31 10:02:39.702026 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 622/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:39 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:40.722346 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:40.723123 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:40.730545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:40.731090 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:40.731587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:40.732617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:40.733232 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:40.733552 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:40.936010 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:40.943739 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4f41912a-b646-4f64-997c-0e27c4965a27 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.225385 Aug 31 10:02:40.944317 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 614/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:40 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:41.413016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-7de00a22-c614-4406-9f6c-1b3efe27cb8c req-fbcb6818-edf4-46c9-ae3f-7d4a9382c262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:41.423951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-7de00a22-c614-4406-9f6c-1b3efe27cb8c req-fbcb6818-edf4-46c9-ae3f-7d4a9382c262 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:41.424436 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-7de00a22-c614-4406-9f6c-1b3efe27cb8c req-fbcb6818-edf4-46c9-ae3f-7d4a9382c262 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:41.424876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-7de00a22-c614-4406-9f6c-1b3efe27cb8c req-fbcb6818-edf4-46c9-ae3f-7d4a9382c262 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:41.437707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-7de00a22-c614-4406-9f6c-1b3efe27cb8c req-fbcb6818-edf4-46c9-ae3f-7d4a9382c262 service nova] Creating event network-changed:9dc46c67-12de-4d8e-8d34-5ce5ddca1b28 for instance 15b9c17b-5a86-4b37-a786-78719cd778a8 on hv-cinder-83754 Aug 31 10:02:41.442722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-7de00a22-c614-4406-9f6c-1b3efe27cb8c req-fbcb6818-edf4-46c9-ae3f-7d4a9382c262 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033455 Aug 31 10:02:41.443545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 623/1237] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:02:41.965020 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:41.965644 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:41.971952 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:41.972440 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:41.972880 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:41.973610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:41.974066 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:41.974488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:42.102929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:42.110658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bf31b45a-4f68-4620-b1c5-46446606d365 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.149577 Aug 31 10:02:42.111231 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 615/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:41 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:43.132579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:43.133374 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:43.140115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:43.140602 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:43.141066 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:43.141755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:43.142422 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:43.142847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:43.273958 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:43.283161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-fc838a07-04b5-4e3f-ab0c-9537ab93008c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.155287 Aug 31 10:02:43.283733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 624/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:43 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:44.302925 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:44.303536 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:44.310024 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.310506 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.310940 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.311662 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.312136 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.312578 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.450728 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:44.458268 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1bf0e819-69db-48a8-9bef-63e625a8552a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.159188 Aug 31 10:02:44.458962 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 616/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:44 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:45.479484 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:45.480090 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:45.486545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.487024 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.487453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.488139 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.488588 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.489030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.622125 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:45.629742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-34ba17d3-a6e0-43cb-aaad-84a99de24aaa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.154862 Aug 31 10:02:45.630307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 625/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:45 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:46.650350 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:46.650911 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:46.657573 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:46.658055 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:46.658489 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:46.659173 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:46.659627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:46.660047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:46.788129 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:46.796230 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-363a6d3b-61d7-4731-9d6c-48330666d0b0 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.149895 Aug 31 10:02:46.796800 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 617/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:46 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:47.817819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:47.818432 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:47.825380 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:47.825869 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:47.826304 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:47.826994 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:47.827447 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:47.827872 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:47.958839 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:47.967035 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9d6251a7-33ea-4dcb-9766-7b0aea562240 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.153145 Aug 31 10:02:47.967601 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 626/1243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:47 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:48.987696 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:48.988306 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:48.990710 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell0:SELECT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:48.996011 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:48.996492 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:48.996926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:48.997688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:48.998144 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:48.998563 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:49.129883 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:49.137939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d2aa27b2-9d66-4786-851d-fce0dbc108ea tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.154138 Aug 31 10:02:49.138524 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 618/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:48 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:50.159044 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:50.159654 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:50.161614 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=2 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:50.162275 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell0:SELECT=6 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:50.169444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:50.169926 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:50.170361 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:50.171048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:50.171502 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:50.172196 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:50.303417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:50.311052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a6f467e7-4789-435f-8ca3-e2a5c23d3af8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.155843 Aug 31 10:02:50.311613 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 627/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:50 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:51.335744 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:51.336343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:51.343435 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:51.343879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:51.344320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:51.345042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:51.345504 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:51.345935 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:51.475358 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:51.483268 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c39b4569-90fd-45b3-a20b-5cf1a1449895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.151413 Aug 31 10:02:51.483846 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 619/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:51 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:52.503853 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:52.504465 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:52.511675 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:52.512161 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:52.512597 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:52.513319 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:52.513777 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:52.514206 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:52.645660 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:52.653387 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-74b051d0-e9c8-4a1d-bff8-9cc3eb67f76a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.153397 Aug 31 10:02:52.653962 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 628/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:52 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:53.674666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:53.675339 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:53.682171 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:53.682644 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:53.683073 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:53.683749 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:53.684194 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:53.684613 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:53.811320 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:53.818927 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-d770b788-0ada-41f4-adad-93085b205e45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.148357 Aug 31 10:02:53.819496 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 620/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:53 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:54.282107 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-03b263df-d95a-48f8-a65f-253464ce88d5 req-6e6c3291-fdfa-47d0-bf7b-f6392f63ebf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "name": "network-vif-plugged", "status": "completed", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:54.292382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-03b263df-d95a-48f8-a65f-253464ce88d5 req-6e6c3291-fdfa-47d0-bf7b-f6392f63ebf6 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:54.292713 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-03b263df-d95a-48f8-a65f-253464ce88d5 req-6e6c3291-fdfa-47d0-bf7b-f6392f63ebf6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:54.293178 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-03b263df-d95a-48f8-a65f-253464ce88d5 req-6e6c3291-fdfa-47d0-bf7b-f6392f63ebf6 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:54.304722 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-03b263df-d95a-48f8-a65f-253464ce88d5 req-6e6c3291-fdfa-47d0-bf7b-f6392f63ebf6 service nova] Creating event network-vif-plugged:9dc46c67-12de-4d8e-8d34-5ce5ddca1b28 for instance 15b9c17b-5a86-4b37-a786-78719cd778a8 on hv-cinder-83754 Aug 31 10:02:54.309785 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-03b263df-d95a-48f8-a65f-253464ce88d5 req-6e6c3291-fdfa-47d0-bf7b-f6392f63ebf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031415 Aug 31 10:02:54.310377 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 629/1249] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:02:54.840032 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:54.840642 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:54.847025 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:54.847503 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:54.847937 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:54.848622 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:54.849100 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:54.849522 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:54.978204 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:54.985771 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-78a7ac62-6c91-4097-929f-1670628ae14e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.149614 Aug 31 10:02:54.986337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 621/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:54 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:56.007951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:56.009209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:56.015318 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:56.015803 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:56.016241 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:56.016930 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:56.017417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:56.017844 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:56.147899 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:56.155762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3bfc0813-e87d-430a-b1c6-6c0162501304 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1258 microversion: 2.1 time: 0.152551 Aug 31 10:02:56.156326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 630/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:56 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:57.175862 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:57.176463 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:57.182899 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:57.183378 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:57.183803 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:57.184482 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:57.184929 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:57.185375 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:57.315930 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:57.323990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-1a5f049b-37da-4be1-85ae-5713dfaf6497 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1442 microversion: 2.1 time: 0.152260 Aug 31 10:02:57.324556 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 622/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:57 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:57.344260 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:57.344804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:57.351273 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:57.351755 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:57.352198 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:57.352884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:57.353389 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:57.353814 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:57.485709 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:57.493982 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-903bbb13-373d-48ed-bd7b-bc8f3e3e0347 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1442 microversion: 2.1 time: 0.153625 Aug 31 10:02:57.494548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 631/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:57 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:59.388616 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-3917ef02-4211-4d87-982a-b68094c6ff8a req-d607d7b9-26ca-4239-9f30-2fece3d99b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:59.397989 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3917ef02-4211-4d87-982a-b68094c6ff8a req-d607d7b9-26ca-4239-9f30-2fece3d99b1c service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:59.398454 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3917ef02-4211-4d87-982a-b68094c6ff8a req-d607d7b9-26ca-4239-9f30-2fece3d99b1c service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:59.399476 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-3917ef02-4211-4d87-982a-b68094c6ff8a req-d607d7b9-26ca-4239-9f30-2fece3d99b1c service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:59.410200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-3917ef02-4211-4d87-982a-b68094c6ff8a req-d607d7b9-26ca-4239-9f30-2fece3d99b1c service nova] Creating event network-changed:9dc46c67-12de-4d8e-8d34-5ce5ddca1b28 for instance 15b9c17b-5a86-4b37-a786-78719cd778a8 on hv-cinder-83754 Aug 31 10:02:59.415210 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-3917ef02-4211-4d87-982a-b68094c6ff8a req-d607d7b9-26ca-4239-9f30-2fece3d99b1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087044 Aug 31 10:02:59.415965 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 623/1254] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:03:12.180857 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-566419876"}} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:03:12.181498 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:12.184135 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:03:12.184900 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=54 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:03:12.191238 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:12.191718 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:12.193410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:12.193410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:12.193410 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:12.194341 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:12.337605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.network.security_group_api [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Removing security group 5fd6fee5-81cb-4545-a9a7-5c524d937a70 from port 38507c74-1bb4-4d21-82bb-9017585156a0 Aug 31 10:03:12.655207 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-9cb68b6c-8574-4925-a968-32a187b0b7ef tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/action" status: 202 len: 0 microversion: 2.1 time: 0.478866 Aug 31 10:03:12.655828 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 632/1255] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 10:03:12 2022] POST /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:03:12.664480 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=24 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:03:12.665688 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=56 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:03:12.670052 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-261f2a1e-e077-4eb9-83d6-159a25375ffe req-03a56e2d-5352-4917-ba95-5dae8e957c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:03:12.681677 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-261f2a1e-e077-4eb9-83d6-159a25375ffe req-03a56e2d-5352-4917-ba95-5dae8e957c01 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:12.682156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-261f2a1e-e077-4eb9-83d6-159a25375ffe req-03a56e2d-5352-4917-ba95-5dae8e957c01 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:12.682583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-261f2a1e-e077-4eb9-83d6-159a25375ffe req-03a56e2d-5352-4917-ba95-5dae8e957c01 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:12.694625 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-261f2a1e-e077-4eb9-83d6-159a25375ffe req-03a56e2d-5352-4917-ba95-5dae8e957c01 service nova] Creating event network-changed:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 10:03:12.700488 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-261f2a1e-e077-4eb9-83d6-159a25375ffe req-03a56e2d-5352-4917-ba95-5dae8e957c01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037403 Aug 31 10:03:12.701782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 624/1256] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:03:13.788368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:13.789060 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:13.795114 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:13.795610 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:13.796049 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:13.797653 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:13.798116 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:13.798546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:13.880041 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lazy-loading 'services' on Instance uuid 4b3219ed-9d4e-496b-92a6-cb509658e005 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:03:13.955885 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-29ebec7b-c21b-42cd-8c2b-eb092cb1678a tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments/9c96e657-965b-4bb2-b33f-13766f695e0c" status: 202 len: 0 microversion: 2.1 time: 0.171798 Aug 31 10:03:13.956492 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 633/1257] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 10:03:13 2022] DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments/9c96e657-965b-4bb2-b33f-13766f695e0c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:03:13.966790 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:13.969213 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:13.975658 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:13.976199 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:13.976750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:13.977571 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:13.978024 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:13.978580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:14.011083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e657e9cc-bf87-4871-8176-174a414fcdb2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049326 Aug 31 10:03:14.011667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 625/1258] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 10:03:13 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:03:14.715905 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-00152906-8a5f-420f-a5d0-46572e8b7375 req-64f0c66b-ceba-4c62-a4bf-3fac9749e79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:03:14.725442 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-00152906-8a5f-420f-a5d0-46572e8b7375 req-64f0c66b-ceba-4c62-a4bf-3fac9749e79b service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:14.725921 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-00152906-8a5f-420f-a5d0-46572e8b7375 req-64f0c66b-ceba-4c62-a4bf-3fac9749e79b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:14.726968 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-00152906-8a5f-420f-a5d0-46572e8b7375 req-64f0c66b-ceba-4c62-a4bf-3fac9749e79b service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:14.737681 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-00152906-8a5f-420f-a5d0-46572e8b7375 req-64f0c66b-ceba-4c62-a4bf-3fac9749e79b service nova] Creating event network-changed:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 10:03:14.743077 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-00152906-8a5f-420f-a5d0-46572e8b7375 req-64f0c66b-ceba-4c62-a4bf-3fac9749e79b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031199 Aug 31 10:03:14.743684 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 634/1259] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:03:15.025586 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:15.029632 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:15.035909 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:15.036407 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:15.036832 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:15.037545 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:15.037989 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:15.038403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:15.068770 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8d7e48b5-fb1a-4fb6-ac68-e4433938d16d tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048718 Aug 31 10:03:15.069576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 626/1260] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 31 10:03:15 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:03:15.081470 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:15.082063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:15.088792 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:15.089310 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:15.089742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:15.090579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:15.090940 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:15.091413 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:15.175334 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] HTTP exception thrown: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 is not attached to volume 9c96e657-965b-4bb2-b33f-13766f695e0c Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Request method failure captured: Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments/9c96e657-965b-4bb2-b33f-13766f695e0c HTTP/1.1 Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDzDVG0-O4P0oEaBxCn3UXksx9UqV-u63H1h1UsuLG5P1EbFMVp05GdaOBa1-01shU6XcjSdcZZQTD3jkQaK1p47pgb5uZvZfS9nHgtnSgoGx6zU242zQ4pCA-oXD7Ujkyd4NhmI7rXwJD9ZKJZhc_zRQ-u0OzXINYMzZEpleBiOQf4Y Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: df7a0ee4a83f48d78f1c941172cacdb9 Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-TestMinimumBasicScenario-957383341 Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 10:03:15.177650 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df7a0ee4a83f48d78f1c941172cacdb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df7a0ee4a83f48d78f1c941172cacdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df7a0ee4a83f48d78f1c941172cacdb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df7a0ee4a83f48d78f1c941172cacdb9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-TestMinimumBasicScenario-957383341 Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: df7a0ee4a83f48d78f1c941172cacdb9 Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-TestMinimumBasicScenario-957383341 Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-TestMinimumBasicScenario-957383341-project Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: 633f1828cf87496fbc0dad682bf9986b Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-TestMinimumBasicScenario-957383341-project Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 10:03:15.179523 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 is not attached to volume 9c96e657-965b-4bb2-b33f-13766f695e0c Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'server_id': '4b3219ed-9d4e-496b-92a6-cb509658e005', 'id': '9c96e657-965b-4bb2-b33f-13766f695e0c'} Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c96e657-965b-4bb2-b33f-13766f695e0c. Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:03:15.180500 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 is not attached to volume 9c96e657-965b-4bb2-b33f-13766f695e0c Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 is not attached to volume 9c96e657-965b-4bb2-b33f-13766f695e0c Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:03:15.185194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Returning 404 to user: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 is not attached to volume 9c96e657-965b-4bb2-b33f-13766f695e0c {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:03:15.186428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-072aff90-4748-4428-9019-15b7583c3f64 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments/9c96e657-965b-4bb2-b33f-13766f695e0c" status: 404 len: 154 microversion: 2.1 time: 0.103890 Aug 31 10:03:15.186428 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 635/1261] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 31 10:03:15 2022] DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005/os-volume_attachments/9c96e657-965b-4bb2-b33f-13766f695e0c => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:03:16.327305 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:16.327833 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:16.335495 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:16.335980 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:16.336412 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:16.337151 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:16.337604 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:16.338025 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:16.365760 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:03:16.442842 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-97fb5975-ca69-4d34-97ac-c0589dd3b2c2 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 204 len: 0 microversion: 2.1 time: 0.119001 Aug 31 10:03:16.443462 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 627/1262] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 10:03:16 2022] DELETE /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:03:16.452353 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:16.453071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:16.459454 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:16.459938 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:16.460402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:16.461156 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:16.461617 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:16.462042 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:16.592934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:16.600692 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-57953a62-23c8-4904-9e2f-6ce6f039086c tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1553 microversion: 2.1 time: 0.152287 Aug 31 10:03:16.601308 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 636/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:03:16 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:03:17.622023 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:17.622715 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:17.629135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:17.629610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:17.630039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:17.630712 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:17.631157 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:17.631572 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:17.762596 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:17.770314 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-162376ab-88e4-412f-9467-32841512c451 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1553 microversion: 2.1 time: 0.152521 Aug 31 10:03:17.770892 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 628/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:03:17 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:03:18.791800 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:18.792408 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:18.798874 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:18.799357 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:18.799791 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:18.800486 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:18.800941 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:18.801425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:18.932698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:18.940384 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-493bccdb-fb26-456b-9e92-f215a63a0445 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1553 microversion: 2.1 time: 0.152487 Aug 31 10:03:18.940978 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 637/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:03:18 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:03:19.671921 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-6c50704f-0849-4d76-afae-84f3fac3f293 req-eca46190-8325-45c3-b434-432cd3ac2070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3219ed-9d4e-496b-92a6-cb509658e005", "name": "network-vif-deleted", "tag": "38507c74-1bb4-4d21-82bb-9017585156a0"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:03:19.681799 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-6c50704f-0849-4d76-afae-84f3fac3f293 req-eca46190-8325-45c3-b434-432cd3ac2070 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:19.682283 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-6c50704f-0849-4d76-afae-84f3fac3f293 req-eca46190-8325-45c3-b434-432cd3ac2070 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:19.682716 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-6c50704f-0849-4d76-afae-84f3fac3f293 req-eca46190-8325-45c3-b434-432cd3ac2070 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:19.695410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-6c50704f-0849-4d76-afae-84f3fac3f293 req-eca46190-8325-45c3-b434-432cd3ac2070 service nova] Creating event network-vif-deleted:38507c74-1bb4-4d21-82bb-9017585156a0 for instance 4b3219ed-9d4e-496b-92a6-cb509658e005 on hv-cinder-83754 Aug 31 10:03:19.701409 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-6c50704f-0849-4d76-afae-84f3fac3f293 req-eca46190-8325-45c3-b434-432cd3ac2070 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 Aug 31 10:03:19.702137 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 629/1266] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:03:19.961303 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:19.961983 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:19.968517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:19.969040 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:19.969485 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:19.970195 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:19.970649 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:19.971715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:20.004075 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:20.004566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:20.005029 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:20.005489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.objects.instance [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lazy-loading 'fault' on Instance uuid 4b3219ed-9d4e-496b-92a6-cb509658e005 {{(pid=132479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:03:20.048191 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633f1828cf87496fbc0dad682bf9986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7a0ee4a83f48d78f1c941172cacdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:20.056621 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-eaa1d55f-dcfb-4321-9fd5-3e7c7c293712 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 200 len: 1348 microversion: 2.1 time: 0.099840 Aug 31 10:03:20.057552 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 638/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:03:19 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:03:21.079087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:21.079775 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] [instance: 4b3219ed-9d4e-496b-92a6-cb509658e005] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:21.086823 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:21.087310 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:21.087741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:21.088431 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:21.088876 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:21.089323 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:21.104318 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.wsgi [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] HTTP exception thrown: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 could not be found. Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Request method failure captured: Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: request: GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 HTTP/1.1 Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept: application/json Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Accept-Encoding: identity Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Connection: close Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Length: 0 Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Content-Type: application/json Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Host: 10.222.0.25 Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Openstack-System-Scope: None Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: User-Agent: python-urllib3/1.26.12 Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Auth-Token: gAAAAABjDzDVG0-O4P0oEaBxCn3UXksx9UqV-u63H1h1UsuLG5P1EbFMVp05GdaOBa1-01shU6XcjSdcZZQTD3jkQaK1p47pgb5uZvZfS9nHgtnSgoGx6zU242zQ4pCA-oXD7Ujkyd4NhmI7rXwJD9ZKJZhc_zRQ-u0OzXINYMzZEpleBiOQf4Y Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Id: None Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Domain-Name: None Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Identity-Status: Confirmed Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Is-Admin-Project: True Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Id: default Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Domain-Name: Default Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Id: df7a0ee4a83f48d78f1c941172cacdb9 Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Project-Name: tempest-TestMinimumBasicScenario-957383341 Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Role: reader,member Aug 31 10:03:21.106251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Roles: reader,member Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df7a0ee4a83f48d78f1c941172cacdb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df7a0ee4a83f48d78f1c941172cacdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df7a0ee4a83f48d78f1c941172cacdb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df7a0ee4a83f48d78f1c941172cacdb9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant: tempest-TestMinimumBasicScenario-957383341 Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Id: df7a0ee4a83f48d78f1c941172cacdb9 Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-Tenant-Name: tempest-TestMinimumBasicScenario-957383341 Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User: tempest-TestMinimumBasicScenario-957383341-project Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Id: default Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Domain-Name: Default Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Id: 633f1828cf87496fbc0dad682bf9986b Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: X-User-Name: tempest-TestMinimumBasicScenario-957383341-project Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: method: > Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: exception: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 could not be found. Aug 31 10:03:21.108111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: action_args: {'id': '4b3219ed-9d4e-496b-92a6-cb509658e005'} Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 could not be found. Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:03:21.109198 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 could not be found. Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 could not be found. Aug 31 10:03:21.110888 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR nova.api.openstack.wsgi Aug 31 10:03:21.112580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Returning 404 to user: Instance 4b3219ed-9d4e-496b-92a6-cb509658e005 could not be found. {{(pid=132478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:03:21.112580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c4828920-5a26-4211-9ae5-b7ca0e8d4737 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005" status: 404 len: 111 microversion: 2.1 time: 0.032838 Aug 31 10:03:21.112580 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 630/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:03:21 2022] GET /compute/v2.1/servers/4b3219ed-9d4e-496b-92a6-cb509658e005 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:03:21.116451 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-e1a6ecf0-ac35-4e5e-b674-345482b22f43 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] Calling method '.version_select at 0x7f0b5291de50>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:21.138138 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-e1a6ecf0-ac35-4e5e-b674-345482b22f43 tempest-TestMinimumBasicScenario-957383341 tempest-TestMinimumBasicScenario-957383341-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1058081237" status: 202 len: 0 microversion: 2.1 time: 0.025409 Aug 31 10:03:21.138698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 639/1269] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Aug 31 10:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1058081237 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:05:18.005631 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bebad543-6261-4e6f-99ea-af3ba8ccb0d6] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 10:05:18.006442 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:18.007166 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:18.007979 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:05:18.008122 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Wed Aug 31 10:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8/action (ip 10.222.0.25) !!! Aug 31 10:05:18.009149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:05:18.009279 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: Wed Aug 31 10:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8/action (ip 10.222.0.25) !!! Aug 31 10:05:18.015363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:05:18.015910 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:18.027146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:18.027652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:18.028083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:18.028767 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:18.029247 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:18.029666 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:18.053248 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lazy-loading 'flavor' on Instance uuid 15b9c17b-5a86-4b37-a786-78719cd778a8 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:05:18.124606 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-bea8a7ef-9c47-4e69-99f7-fe85df78a2da tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "POST /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8/action" status: 202 len: 0 microversion: 2.1 time: 0.120736 Aug 31 10:05:18.125868 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 631/1270] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 10:05:18 2022] POST /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:05:18.134021 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18f54f28-b678-4304-b934-0855f6dd90c6] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 10:05:18.134727 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:18.135707 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:18.142829 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:18.143489 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:18.154801 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:18.155300 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:18.155737 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:18.156943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:18.157430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:18.157876 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:18.288445 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:18.296440 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-d1ac84a2-2ab4-467e-b39d-63afcddd3e0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.165376 Aug 31 10:05:18.297642 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 640/1271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:18 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:19.319793 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:19.320520 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:19.327855 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:19.328337 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:19.328772 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:19.329484 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:19.329939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:19.330363 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:19.335101 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO oslo.messaging._drivers.impl_rabbit [-] [bebad543-6261-4e6f-99ea-af3ba8ccb0d6] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42366. Aug 31 10:05:19.700249 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:19.708500 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-88e1cf0f-ae2d-494d-b31a-b185bd18596f tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.394027 Aug 31 10:05:19.709083 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 632/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:19 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:20.730018 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:20.730641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:20.740407 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:20.740888 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:20.741359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:20.742048 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:20.742526 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:20.742943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:20.746219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [-] [18f54f28-b678-4304-b934-0855f6dd90c6] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42370. Aug 31 10:05:20.881162 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:20.889616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-84501c3b-d884-4578-8637-e1c11bb2883e tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.163479 Aug 31 10:05:20.890390 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 641/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:20 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:21.912156 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:21.912718 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:21.919267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:21.919751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:21.920187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:21.920879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:21.921365 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:21.922438 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:22.051652 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:22.059429 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ed306caa-c8b7-4737-a577-a2402def6895 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.151239 Aug 31 10:05:22.059999 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 633/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:21 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:23.080863 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:23.081514 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:23.087873 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:23.088358 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:23.088793 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:23.089512 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:23.089943 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:23.090364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:23.218426 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:23.226178 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3504ad77-4580-4b43-b526-25b8c1373422 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.149711 Aug 31 10:05:23.226733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 642/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:23 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:24.247254 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:24.247857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:24.254226 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:24.254705 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:24.255135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:24.255819 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:24.256271 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:24.256690 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:24.387421 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:24.395042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-ffcbb1f1-da65-4dc8-8868-88665ac10bed tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.151597 Aug 31 10:05:24.395607 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 634/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:24 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:25.416652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:25.417244 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:25.424364 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:25.424846 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:25.425307 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:25.425992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:25.426444 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:25.426892 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:25.560837 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:25.569111 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-24c3f97a-f443-4c2c-8d33-cd0aab2c383a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.156381 Aug 31 10:05:25.569695 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 643/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:25 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:26.590068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:26.590704 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:26.597042 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:26.597531 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:26.597972 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:26.598693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:26.599152 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:26.599582 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:26.735344 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:26.742971 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-b741b14e-7a93-4e39-b6a8-095381332b0c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.156855 Aug 31 10:05:26.743535 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 635/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:26 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:27.764343 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:27.764951 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:27.771887 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:27.772368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:27.772804 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:27.773520 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:27.773977 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:27.774400 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:27.908146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:27.915998 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-ba4287ba-3dbc-4f4c-b02b-d78acfdbe594 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.155529 Aug 31 10:05:27.916581 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 644/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:27 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:28.938699 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:28.939319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:28.945831 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:28.946313 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:28.946750 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:28.947441 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:28.947893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:28.948315 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:29.081207 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:29.089920 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-55b1f3be-98e5-4b30-ab06-0020a25f49cc tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.154438 Aug 31 10:05:29.090135 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 636/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:28 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:30.111758 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:30.112383 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:30.119024 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:30.119548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:30.119989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:30.120679 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:30.121175 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:30.121605 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:30.257939 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:30.265663 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-4b9aafa8-3f28-4237-a0de-29cc45466e43 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.158336 Aug 31 10:05:30.266233 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 645/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:30 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:31.287134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:31.287727 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:31.294434 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:31.294918 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:31.295343 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:31.296734 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:31.297219 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:31.297643 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:31.500574 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:31.508984 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-19bf8aa8-a678-4384-a241-3fc1d814dd10 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.225677 Aug 31 10:05:31.509674 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 637/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:31 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:32.530562 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:32.531208 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:32.537698 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:32.538190 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:32.538628 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:32.539320 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:32.539779 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:32.540209 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:32.672599 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:32.680379 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-73056b42-cf2a-4dd8-bcfd-184a7ce74339 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1507 microversion: 2.1 time: 0.153785 Aug 31 10:05:32.680980 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 646/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:32 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:32.701747 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:05:32.702966 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:32.709293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:32.709781 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:32.710220 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:32.710912 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:32.711403 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:32.711830 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:32.865857 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132478) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 10:05:32.934751 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-59767225-54c9-4bae-bad3-9ccb1bcbcca5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "POST /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8/action" status: 202 len: 0 microversion: 2.1 time: 0.236609 Aug 31 10:05:32.935174 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 638/1284] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 31 10:05:32 2022] POST /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:05:32.944256 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:32.944875 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:32.950897 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:32.951391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:32.951826 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:32.952756 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:32.953474 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:32.953987 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:33.086112 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:33.094466 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-a64df56d-45ef-4f35-9e68-8037ab549aca tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1515 microversion: 2.1 time: 0.154187 Aug 31 10:05:33.095115 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 647/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:32 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:05:34.115784 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:34.116397 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:34.122410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:34.122893 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:34.123327 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:34.124016 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:34.124983 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:34.125410 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:34.263002 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:34.271533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-e8d587b5-b02e-4f52-86e4-e82ab18c3d45 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1515 microversion: 2.1 time: 0.159752 Aug 31 10:05:34.272111 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 639/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:34 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:35.014155 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-22fa71d1-1035-4c6f-b9ba-44a975d7495a req-57da2868-0947-4e07-bf7f-488352c16742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "name": "network-vif-unplugged", "status": "completed", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:05:35.024069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-22fa71d1-1035-4c6f-b9ba-44a975d7495a req-57da2868-0947-4e07-bf7f-488352c16742 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:35.024533 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-22fa71d1-1035-4c6f-b9ba-44a975d7495a req-57da2868-0947-4e07-bf7f-488352c16742 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:35.024984 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-22fa71d1-1035-4c6f-b9ba-44a975d7495a req-57da2868-0947-4e07-bf7f-488352c16742 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:35.037674 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.compute.server_external_events [req-22fa71d1-1035-4c6f-b9ba-44a975d7495a req-57da2868-0947-4e07-bf7f-488352c16742 service nova] Unable to find a host for instance 15b9c17b-5a86-4b37-a786-78719cd778a8. Dropping event network-vif-unplugged {{(pid=132479) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 10:05:35.038548 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-22fa71d1-1035-4c6f-b9ba-44a975d7495a req-57da2868-0947-4e07-bf7f-488352c16742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.092384 Aug 31 10:05:35.039131 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 648/1287] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 10:05:35.292044 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:35.292916 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:35.299828 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:35.300340 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:35.300776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:35.301502 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:35.301962 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:35.302388 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:35.430990 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:35.439075 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-5e16b41f-99cc-45e2-8b89-0003394ebbfa tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1515 microversion: 2.1 time: 0.151079 Aug 31 10:05:35.439583 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 640/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:35 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:36.459626 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:36.460270 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:36.466871 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:36.467352 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:36.468285 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:36.469003 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:36.469453 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:36.469878 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:36.609425 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:36.617121 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-94493df0-3168-45d8-89b7-b6497f5310ff tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1515 microversion: 2.1 time: 0.161396 Aug 31 10:05:36.617694 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 649/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:36 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:37.638530 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:37.639147 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:37.646282 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:37.646769 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:37.647200 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:37.647890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:37.648345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:37.648768 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:37.787177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:37.795126 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c3c10e91-fec7-4f4c-9f54-7d4847a972f1 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1515 microversion: 2.1 time: 0.160518 Aug 31 10:05:37.795706 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 641/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:37 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:38.815842 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:38.816541 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:38.823276 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:38.823843 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:38.824291 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:38.825016 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:38.825477 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:38.825906 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:38.956752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:38.964529 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-94c473aa-aadf-47f9-8ca2-db0628ea14c7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.152794 Aug 31 10:05:38.965108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 650/1291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:38 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:05:39.987112 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:39.987729 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:39.994211 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:39.994700 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:39.995137 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:39.995829 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:39.996284 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:39.996708 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:40.128457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:40.136149 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7a31a5f2-39a2-4f78-8f82-15c376fa933a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.153496 Aug 31 10:05:40.136711 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 642/1292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:39 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:41.156769 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:41.157411 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:41.163934 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:41.164417 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:41.164852 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:41.165572 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:41.166030 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:41.166460 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:41.297652 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:41.305400 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-984bb38d-ea7e-4a27-bc24-57eca85c8c06 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.152565 Aug 31 10:05:41.305974 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 651/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:41 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:42.327485 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:42.328117 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:42.334491 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:42.334973 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:42.335401 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:42.336087 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:42.336533 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:42.336948 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:42.469664 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:42.477259 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-8136b3ad-5d4c-4e05-a835-ee5c9ec98f94 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.154208 Aug 31 10:05:42.477817 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 643/1294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:42 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:43.498096 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:43.498752 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:43.505146 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:43.505631 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:43.506063 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:43.506747 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:43.507197 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:43.507616 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:43.640591 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:43.648240 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-b53b7952-3201-4a7d-90ac-4c9186fda692 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.154011 Aug 31 10:05:43.648802 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 652/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:43 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:44.669939 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:44.670590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:44.677866 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:44.678355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:44.678786 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:44.679474 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:44.679926 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:44.680347 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:44.698187 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:44.815981 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:44.823576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-92a8e300-25f4-4b4b-b1b1-0e6ae74d9bd4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.157793 Aug 31 10:05:44.824146 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 644/1296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:44 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:45.844735 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:45.845326 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:45.851762 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:45.852245 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:45.852670 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:45.853373 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:45.853819 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:45.854235 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:45.984833 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:45.992480 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-3df4cb51-8a49-4b9d-9136-9821f0b46a3c tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.151656 Aug 31 10:05:45.993059 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 653/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:45 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:47.013182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:47.013789 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:47.020667 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:47.021177 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:47.021610 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:47.022285 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:47.022761 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:47.023182 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:47.151822 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:47.159936 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-c277a0dc-b0b8-4ff6-9539-413d58d794bd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.150673 Aug 31 10:05:47.160498 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 645/1298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:47 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:48.185990 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:48.186598 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:48.189007 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=29 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:48.194825 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:48.195306 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:48.195733 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:48.197103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:48.197103 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:48.197370 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:48.199915 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=81 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:48.330618 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:48.338248 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-8266c07c-155b-45f0-998b-9ebad8206265 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.156463 Aug 31 10:05:48.338808 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 654/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:48 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:49.360516 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:49.361103 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:49.363068 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:49.368293 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:49.368782 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:49.369251 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:49.369944 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:49.370397 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:49.370824 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:49.501741 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:49.509457 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7144b26f-f327-4994-a200-641f3480c4b8 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.153367 Aug 31 10:05:49.510034 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 646/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:49 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:50.531359 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:50.531975 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:50.538655 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:50.539174 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:50.539612 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:50.540309 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:50.540767 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:50.541229 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:50.670110 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:50.678368 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-028a28c1-39ff-419d-962d-610ca73cc6d4 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.151408 Aug 31 10:05:50.678973 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 655/1301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:50 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:51.081963 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-d25d3878-a6ff-44d3-98ee-a9ddc89991e4 req-943a59a6-6f4e-41eb-8040-8125d8b726b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "name": "network-vif-plugged", "status": "completed", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:05:51.092534 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d25d3878-a6ff-44d3-98ee-a9ddc89991e4 req-943a59a6-6f4e-41eb-8040-8125d8b726b7 service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:51.093047 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d25d3878-a6ff-44d3-98ee-a9ddc89991e4 req-943a59a6-6f4e-41eb-8040-8125d8b726b7 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:51.093483 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-d25d3878-a6ff-44d3-98ee-a9ddc89991e4 req-943a59a6-6f4e-41eb-8040-8125d8b726b7 service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:51.105229 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-d25d3878-a6ff-44d3-98ee-a9ddc89991e4 req-943a59a6-6f4e-41eb-8040-8125d8b726b7 service nova] Creating event network-vif-plugged:9dc46c67-12de-4d8e-8d34-5ce5ddca1b28 for instance 15b9c17b-5a86-4b37-a786-78719cd778a8 on hv-cinder-83754 Aug 31 10:05:51.110590 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-d25d3878-a6ff-44d3-98ee-a9ddc89991e4 req-943a59a6-6f4e-41eb-8040-8125d8b726b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Aug 31 10:05:51.111385 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 647/1302] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:05:51.700449 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:51.701036 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:51.707579 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:51.708071 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:51.708510 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:51.709228 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:51.709685 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:51.710117 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:51.841949 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:51.850293 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-391782c7-40a2-4702-a2b3-f9387aadc4f3 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.153889 Aug 31 10:05:51.850868 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 656/1303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:51 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:52.872592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:52.873355 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:52.879405 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:52.879886 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:52.880319 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:52.881039 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:52.881497 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:52.881923 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:53.010514 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:53.018757 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-7d0a58df-b412-47e2-871d-65668409d786 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1573 microversion: 2.1 time: 0.151020 Aug 31 10:05:53.019334 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 648/1304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:52 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:05:54.040556 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:05:54.041219 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:05:54.048731 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:54.049261 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:54.049700 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:54.050402 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:05:54.050858 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:05:54.051284 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:05:54.182662 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:05:54.190855 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-24c39b03-274d-4222-b843-5967fb010ed2 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1560 microversion: 2.1 time: 0.154290 Aug 31 10:05:54.191419 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 657/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:05:54 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:31.796203 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:31.796740 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:31.803611 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_api:SELECT=7 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:31.804509 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG dbcounter [-] [132479] Writing DB stats nova_cell1:SELECT=23 {{(pid=132479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:31.805778 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:07:31.805931 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Wed Aug 31 10:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 31 10:07:31.808746 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_api:SELECT=5 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:31.809422 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG dbcounter [-] [132478] Writing DB stats nova_cell1:SELECT=22 {{(pid=132478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:31.812430 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:07:31.812567 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Wed Aug 31 10:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 31 10:07:31.813611 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:07:31.813742 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Wed Aug 31 10:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 31 10:07:31.820134 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:31.820627 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:31.821093 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:31.821805 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:31.822267 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:31.822693 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:31.856624 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Going to try to terminate instance {{(pid=132478) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:07:31.906517 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [req-f9e33577-0d7b-4cde-8c01-dfdb3f0f9047 req-3c5e1cfd-33c9-424e-8d89-89639d6cf4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:31.917506 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f9e33577-0d7b-4cde-8c01-dfdb3f0f9047 req-3c5e1cfd-33c9-424e-8d89-89639d6cf4cc service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:31.917992 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f9e33577-0d7b-4cde-8c01-dfdb3f0f9047 req-3c5e1cfd-33c9-424e-8d89-89639d6cf4cc service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:31.918427 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [req-f9e33577-0d7b-4cde-8c01-dfdb3f0f9047 req-3c5e1cfd-33c9-424e-8d89-89639d6cf4cc service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:31.929535 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.compute.server_external_events [req-f9e33577-0d7b-4cde-8c01-dfdb3f0f9047 req-3c5e1cfd-33c9-424e-8d89-89639d6cf4cc service nova] Creating event network-changed:9dc46c67-12de-4d8e-8d34-5ce5ddca1b28 for instance 15b9c17b-5a86-4b37-a786-78719cd778a8 on hv-cinder-83754 Aug 31 10:07:31.936566 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [req-f9e33577-0d7b-4cde-8c01-dfdb3f0f9047 req-3c5e1cfd-33c9-424e-8d89-89639d6cf4cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138307 Aug 31 10:07:31.937391 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 658/1306] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:07:31.969617 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-15a5f419-b234-4b07-ae71-8645d55d0e39 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "DELETE /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 204 len: 0 microversion: 2.1 time: 0.177618 Aug 31 10:07:31.970376 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 649/1307] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 31 10:07:31 2022] DELETE /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:07:31.983091 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:31.983798 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:31.992220 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:31.993266 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:31.993705 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:31.994399 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:31.994847 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:31.995267 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:32.193524 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:32.201289 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-187cf423-586a-4fee-85bd-dccb4dfb6335 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.226341 Aug 31 10:07:32.202069 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 659/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:31 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:33.223576 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:33.224288 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:33.231477 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:33.231964 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:33.232400 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:33.233133 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:33.233593 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:33.234018 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:33.478128 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:33.485777 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-0ecfe0d6-ccdc-45c4-bc06-52a1688acdfd tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1566 microversion: 2.1 time: 0.266452 Aug 31 10:07:33.486345 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 650/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:33 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:07:34.507382 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:34.507989 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:34.514884 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:34.515363 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:34.515790 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:34.516479 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:34.516929 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:34.518340 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:34.532879 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [req-a2c534a2-3588-4f62-9c39-c2471b1449bb req-4445b125-7462-47f7-929b-5b2deaabe55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b9c17b-5a86-4b37-a786-78719cd778a8", "name": "network-vif-deleted", "tag": "9dc46c67-12de-4d8e-8d34-5ce5ddca1b28"}]} {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:34.543592 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a2c534a2-3588-4f62-9c39-c2471b1449bb req-4445b125-7462-47f7-929b-5b2deaabe55c service nova] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:34.544311 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a2c534a2-3588-4f62-9c39-c2471b1449bb req-4445b125-7462-47f7-929b-5b2deaabe55c service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:34.544752 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [req-a2c534a2-3588-4f62-9c39-c2471b1449bb req-4445b125-7462-47f7-929b-5b2deaabe55c service nova] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:34.556176 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.compute.server_external_events [req-a2c534a2-3588-4f62-9c39-c2471b1449bb req-4445b125-7462-47f7-929b-5b2deaabe55c service nova] Creating event network-vif-deleted:9dc46c67-12de-4d8e-8d34-5ce5ddca1b28 for instance 15b9c17b-5a86-4b37-a786-78719cd778a8 on hv-cinder-83754 Aug 31 10:07:34.561620 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [req-a2c534a2-3588-4f62-9c39-c2471b1449bb req-4445b125-7462-47f7-929b-5b2deaabe55c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Aug 31 10:07:34.562486 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 651/1310] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 31 10:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:07:34.590639 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.policy [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132479) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:34.598324 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-198f15ba-de1e-47a6-9d02-ab0465616cc9 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1381 microversion: 2.1 time: 0.094836 Aug 31 10:07:34.599545 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 660/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:34 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:35.620466 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:35.621208 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.compute.api [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132478) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:35.627274 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:35.627776 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:35.628201 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:35.628890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:35.629383 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:35.629820 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:35.663022 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:35.663438 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:35.663874 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG oslo_concurrency.lockutils [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:35.664611 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.objects.instance [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lazy-loading 'fault' on Instance uuid 15b9c17b-5a86-4b37-a786-78719cd778a8 {{(pid=132478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:07:35.712587 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.policy [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e170e5057c6f4467b247b2175d2b3ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d82faa2ab445e18d6e3d668821c1e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132478) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:35.720890 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-54f75836-c717-4542-95ae-933eeb57e7f5 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 200 len: 1223 microversion: 2.1 time: 0.105074 Aug 31 10:07:35.721540 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 652/1312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:35 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:36.744226 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '>' {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:36.744773 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.compute.api [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] [instance: 15b9c17b-5a86-4b37-a786-78719cd778a8] Fetching instance by UUID {{(pid=132479) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:36.751129 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:36.751608 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:36.752037 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:36.752715 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Acquiring lock "3da05a9a-2a4d-4b28-8333-0debf927f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:36.753194 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:36.753612 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG oslo_concurrency.lockutils [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Lock "3da05a9a-2a4d-4b28-8333-0debf927f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:36.767108 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.wsgi [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] HTTP exception thrown: Instance 15b9c17b-5a86-4b37-a786-78719cd778a8 could not be found. Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Request method failure captured: Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: request: GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 HTTP/1.1 Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept: application/json Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Accept-Encoding: identity Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Connection: close Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Length: 0 Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Content-Type: application/json Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Host: 10.222.0.25 Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: Openstack-System-Scope: None Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: User-Agent: python-urllib3/1.26.12 Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Auth-Token: gAAAAABjDzGgSAkReS-IiN_Dai7-D-tXYBdGpAutzhVtcvRontK0_ca4jN3MljFRmusjZk--39R2z5ZmnlctWt2VWjFg3PCgLWbZbAUmNQ2wG4hXJ_FPDItj4UYOTZ2Sw9_0jugUIfRVJiQUcGACoTDejmAnX9nQT6s0wcuqH0A2MQvQiDO3QOY Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Id: None Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Domain-Name: None Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Identity-Status: Confirmed Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Is-Admin-Project: True Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Id: default Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Domain-Name: Default Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Id: 52d82faa2ab445e18d6e3d668821c1e5 Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Project-Name: tempest-TestShelveInstance-1367434637 Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Role: reader,member Aug 31 10:07:36.768710 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Roles: reader,member Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52d82faa2ab445e18d6e3d668821c1e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52d82faa2ab445e18d6e3d668821c1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52d82faa2ab445e18d6e3d668821c1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52d82faa2ab445e18d6e3d668821c1e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant: tempest-TestShelveInstance-1367434637 Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Id: 52d82faa2ab445e18d6e3d668821c1e5 Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-Tenant-Name: tempest-TestShelveInstance-1367434637 Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User: tempest-TestShelveInstance-1367434637-project Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Id: default Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Domain-Name: Default Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Id: e170e5057c6f4467b247b2175d2b3ba5 Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: X-User-Name: tempest-TestShelveInstance-1367434637-project Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: method: > Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: exception: Instance 15b9c17b-5a86-4b37-a786-78719cd778a8 could not be found. Aug 31 10:07:36.770546 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: action_args: {'id': '15b9c17b-5a86-4b37-a786-78719cd778a8'} Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: {{(pid=132479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b9c17b-5a86-4b37-a786-78719cd778a8 could not be found. Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:07:36.771641 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b9c17b-5a86-4b37-a786-78719cd778a8 could not be found. Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b9c17b-5a86-4b37-a786-78719cd778a8 could not be found. Aug 31 10:07:36.774052 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: ERROR nova.api.openstack.wsgi Aug 31 10:07:36.775594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: DEBUG nova.api.openstack.wsgi [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Returning 404 to user: Instance 15b9c17b-5a86-4b37-a786-78719cd778a8 could not be found. {{(pid=132479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:07:36.775594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: INFO nova.api.openstack.requestlog [None req-58db1c5b-d434-4926-875e-60948810403a tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8" status: 404 len: 111 microversion: 2.1 time: 0.030386 Aug 31 10:07:36.775594 dv-cinder-837542-8-iscsi devstack@n-api.service[132479]: [pid: 132479|app: 0|req: 661/1313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:36 2022] GET /compute/v2.1/servers/15b9c17b-5a86-4b37-a786-78719cd778a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:07:36.927184 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: DEBUG nova.api.openstack.wsgi [None req-4ccde24c-e500-46ec-aef9-ea87c3b2eee7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] Calling method '.version_select at 0x7f0b528f4c10>' {{(pid=132478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:36.955045 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: INFO nova.api.openstack.requestlog [None req-4ccde24c-e500-46ec-aef9-ea87c3b2eee7 tempest-TestShelveInstance-1367434637 tempest-TestShelveInstance-1367434637-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-102092292" status: 202 len: 0 microversion: 2.1 time: 0.031623 Aug 31 10:07:36.956986 dv-cinder-837542-8-iscsi devstack@n-api.service[132478]: [pid: 132478|app: 0|req: 653/1314] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 31 10:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-102092292 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)